Telepresence Systems and Methods Therefore

ABSTRACT

A telepresence system enhances the perception of presence of a remote person involved in a video conference. The system preferably has a two-way mirror, which is between the observer and the display device, positioned at an angle to reflect a backdrop surface. The backdrop surface may or may not appear superimposed in a position behind the image of a person from the remote location. The system preferably minimizes image distortion via an optical path for the camera line of sight that is substantially longer than the physical distance between the user and the camera. The system may be asymmetrical, in that one camera is on axis with the user&#39;s line of sight while the other camera is off axis with the user&#39;s line of sight.

This application is a continuation of U.S. patent application Ser. No.14/067,263, filed Oct. 30, 2013, entitled “Telepresence Systems andMethods Therefore,” which is a continuation of U.S. patent applicationSer. No. 12/790,160, filed May 28, 2010, entitled “Telepresence Systemsand Methods Therefore,” which is a continuation-in-part of U.S. patentapplication Ser. No. 11/860,366, filed Sep. 24, 2007, entitled “3-DDisplays and Telepresence Systems and Methods Therefore,” now U.S. Pat.No. 8,208,007, which is a continuation-in-part of U.S. patentapplication Ser. No. 11/085,292, filed Mar. 21, 2005, entitled“Reflected Backdrop for Communications Systems,” now U.S. Pat. No.7,760,229, which is a continuation-in-part of U.S. patent applicationSer. No. 10/897,453, filed Jul. 23, 2004, entitled “Reflected Backdropfor Communications Systems,” now U.S. Pat. No. 7,057,637, which claimspriority to Provisional U.S. Patent Application Ser. No. 60/564,098,filed Apr. 21, 2004; all of the above applications being incorporatedherein by reference in their entireties.

U.S. patent application Ser. No. 11/860,366, filed Sep. 24, 2007,entitled “3-D Displays and Telepresence Systems and Methods Therefore,”also claims priority to Provisional U.S. Patent Application Ser. No.60/846,415, filed Sep. 22, 2006, and to Provisional U.S. PatentApplication Ser. No. 60/855,065, filed Oct. 27, 2006, and to ProvisionalU.S. Patent Application Ser. No. 60/968,447, filed Aug. 28, 2007; all ofthe above applications being incorporated herein by reference in theirentireties.

U.S. patent application Ser. No. 12/790,160, filed May 28, 2010,entitled “Telepresence Systems and Methods Therefore,” also claimspriority to Provisional U.S. Patent Application Ser. No. 61/293,553,filed Jan. 8, 2010, entitled “Communications Systems with Eye Contact;”all of the above applications being incorporated herein by reference intheir entireties.

TECHNICAL FIELD

The present invention relates to video conferencing apparatus and moreparticularly to systems and methods for achieving or enhancing“telepresence” which is a perception of presence of a person from adistant location.

BACKGROUND

There is a need for a new type of distance communications system thatachieves “telepresence” which is commonly understood to be a perceptionof presence of a person from a distant location. Telepresence covers abroad range of display and interactive technologies. Most configurationsdo not have an aligned eye contact. Furthermore, they display a flatimage on a screen or a monitor. The flat images produced by theseproducts and display systems do not create the perception of thepresence of the transmitted person in the three-dimensional setting ofthe receiving location.

The perception of the presence of a person within a room can be apowerful form of communication. Observers respond differently to aneffective display of a life-size person in a three-dimensional settingcompared to the common appearance of a person on a flat screen, such asnormal television. In order to achieve this perception, the image of theperson should not be contained by the appearance of the frame of ascreen. This can be accomplished by having the distant person capturedagainst a black background and superimposing the image with a backdropand room setting appearing behind the person. With the proper balance oflight on the backdrop and room setting, the image of the person canappear to be present in free space in front of the background.

There has become a need to develop a telepresence workstationspecifically for a single person to be captured on camera fortransmission to a remote location. Previous configurations have beenmade for desktop solutions, which have had inherent problems. Inparticular, the camera is so close to the person that a wide angle viewis required to capture an image of the upper body of the person. In thisclose position this wide angle of view creates a distorted perspectiveon the person. This problem is particularly obvious when a personreaches forward with a hand.

The distortion of the person can be eliminated by moving the camerafurther back from the person. However, this could make the arrangementof the eye contact system excessively bulky. For many applications thereis not enough available floor space to accommodate this required depth.

Most prior art systems, however, are large and bulky and, hence, cannotphysically fit into most conference rooms. Thus, they are not acceptablefor the majority of applications. Furthermore, the appearance of thetransmitted person into a room setting poses many problems. Since theimage of the transmitted person is superimposed into the room setting,any light surfaces or objects in the room setting will be visiblethrough the image of the person. This will result in a “ghost” effectfor the person. In order to control this visual effect, all of thebackground needs to be illuminated to an exact level of brightness. Itis impractical to specially set the light levels and to select darkcolors for all objects in the room for all applications other thantheatrical settings. As a result, this configuration is generallyunacceptable for normal business usage.

Even with producing custom room settings for these reflected imagedisplay systems, they have a fundamental problem caused by the locationof the displayed image. Since the image of the person is reflected bythe two-way mirror, the image display system is positioned between theobserver and the mirror. As a result, the image on the image displaysystem could be directly viewed by the observer. This would break theillusion of the presence of the person as seen in the reflection of theimage in the two-way mirror. There are various methods for minimizingthe view of the display system, such as using a micro louver film toblock the image from the observation zone. However, these techniques arenot totally effective and darken the image to half or less of itsbrightness. Darkening the image can be a serious problem in that thetwo-way mirror reflects only 30% to 50% percent of the light, causingthe image to be only a small fraction of the brightness of the imagedisplay system. Due to the resulting low brightness of the image, thequality is unsatisfactory.

An additional feature in achieving effective telepresence is theperception of eye contact. It is well known that eye contact can besimulated by positioning a camera on the opposite side of a two-waymirror so that it matches the reflected view of the line of sight of thedisplayed person from the distant location.

There is a range of distance communications systems that are promoted as“telepresence” systems that have a camera positioned outside of theimage display area so that they do not align with the eyes of thedisplayed person. Since the camera is offset from the location of theplacement of the participant appearing on the image display device,these systems do not achieve a perceived eye contact.

There are many telepresence products and solutions on the market, butmost of these do not achieve perceived eye contact. In some applicationsthis eye contact is not essential to the distance communication.However, there are many applications where this eye contact is criticalto the quality of communication between participants. There is a needfor a broad range of configurations that provide eye contact to meet themany applications.

The combination of eye contact and the appearance in a three-dimensionalsetting were presented in the “Communications System” by White WO01/11880 patent application filed Aug. 10, 1999 and published Feb. 15,2001 and U.S. patent application Ser. No. 10/049,253 filed Jul. 24,2000, both incorporated herein by reference. These previousconfigurations have reflected an image of a life-size person so that itis superimposed into a three-dimensional setting. This setting, which isviewed through the two-way mirror, could incorporate a chair andbackground to give the perception that the person is in the room withthe audience. This configuration requires that a large amount of spaceis dedicated to the display system, however.

Numerous configurations display life-size images of people transmittedfrom distant locations with cameras positioned at eye level heightbetween the screens. However, a more effective form of telepresenceachieves eye contact through the use of a two-way mirror. In this eyecontact configuration the two-way mirror is used to match the cameraalignment with the eye level of the display of the transmittedparticipant. Various configurations of eye contact devices have beencommonly known for over twenty years.

One application that is of great importance is for call centers, whichare a major business around the world. There is great potential forusing the staff of the call centers to achieve better communication withcustomers by using telepresence instead of voice only. In thisapplication the call center staff can connect to dedicated telepresencecommunications systems located in stores, public venues or offices.However, call centers usually have a large number of workstations on afloor and space per person is limited. Large telepresence systems usingcurrently available configurations would not fit within the floor plansof these call centers.

PRIOR ART CONFIGURATIONS

Previous configurations have achieved eye contact. The prior art of FIG.1 illustrates a two-way mirror 2 that is angled so that it reflects animage display device 4, such as a monitor or screen. A two-way mirror istypically a partially silvered transparent substrate, which could beglass, plastic, Mylar or other transparent material. A two-way mirrorhas also been referred to as a one-way mirror or a beamsplitter. Thereflected image 5 will appear to be behind the two-way mirror 2. Acamera 1 is placed behind the two-way mirror 2 in a position on the eyelevel of the person displayed on the reflection of the monitor. Thecamera is surrounded by an opaque enclosure 13 so that no light isviewed by the camera 1 as a reflection on the two-way mirror 2. Theinside of the enclosure is black so that the observer 3 does not see thecamera 1 or the enclosure 13 through the two-way mirror 2 and the onlyimage visible to the observer 3 is the reflection 5 of the image on theimage display device 4. This results in the undesirable visual effect ofthe person displayed on the reflected image 5 appearing to be at theback of a black box.

The prior art of FIG. 2 shows a configuration where the camera 1 ispositioned behind the location of the appearance of the reflected image5 on the image display device 4. The camera 1 is positioned in abackground within a three-dimensional setting. An overhead blackoutpanel 16 is positioned above the two-way mirror 2 so that the cameraview of the reflection on the two-way mirror is of a black surface. Inthis manner, the only light exposing the image for the camera will be ofthe observation zone around the observer 3 on the opposite side of thetwo-way mirror 2.

FIG. 3 shows a perspective view of the prior art of FIG. 2. An image ofa person from a remote location is displayed on an image display device4. In this prior art, the image on the image display device 4 is in viewof the observer 3, which is a distraction from the intended view of thereflection of the image 5 of the transmitted person 6. If the image ofthe person in the remote location is produced with a black background,the frame of the reflected image 5 will not add light to thesuperimposed view of the background and the image of the person 6 willbe viewed by the observer as a free standing image within thethree-dimensional setting. A camera 1 may be placed in the room settingat a position that is at the eye level of the observer. Since thereflected image 5 of the remote person 6 is superimposed into the sceneof the room, the normally lit background 12 in the room will be seenthrough the image of the person 6. In particular, a light object, suchas a lamp 10, would clearly show through to give a “ghost” quality tothe image of the person 6.

A disadvantage of this configuration is that a color shift can takeplace when the reflection on the two-way mirror 2 is viewed from anangle of approximately 45 degrees. This color shift can cause thereflected image of the person 6 to appear green. Also, any imperfectionsor distortion in the two-way mirror 2 will cause the image of the personto be degraded. This can be a particular problem if the two-way mirroris comprised of plastic or Mylar substrate.

The prior art of FIG. 4A illustrates an image display device 4 showingan image plane 17 of a person from a remote location, which can bedirectly viewed by an observer 3 through a two-way mirror 2. Theobserver 3 has a direct view along line of sight 220 through the two-waymirror 2 to view an image of a remotely located participant that isdisplayed on an image display device 4.

The two-way mirror 2 is angled downward so that a camera 1 located belowthe two-way mirror 2 views a reflection of the observer 3 and thesurrounding observation zone. As shown in FIG. 4B, the camera 1 viewsupward along a line of sight 222 and is reflected in the two-way mirror2 in the direction of the line of sight 220. The camera view along theline of sight 9 matches or is in close proximity to the line of sight 7in FIG. 4A. When the camera 1 captures an image of the observer 3 alongthe line of sight 9, this image may be transmitted to the location ofthe remote participant for viewing the observer 3 with a perceived eyecontact. In this arrangement the user 3 may have a perceived eye contactwith the remote participant displayed on the image display device 4.Above the two-way mirror 2 is a black panel 16 that is in the cameraview through the two-way mirror 2 so that the only light exposing theimage for the camera 1 is the reflected view of the observation zone.

This prior art does not address the problems that may arise from thesuperimposing of the reflected image of the setting with the camera 1.In particular, the camera may be placed on a table or equipment rackthat could be seen as a reflection in the two-way mirror. This would addan undesirable reflection of the table or equipment rack that wouldsuperimpose into the view of the image display area 17 as it is seenthrough the two-way mirror 2.

Hence, there is a need for an improved system that addresses theshortcomings of the prior art mentioned above.

SUMMARY

The problems and needs outlined above are addressed by embodiments. Inaccordance with one aspect, there is provided a telepresencecommunication system for allowing a user located in an observation zoneto communicate with a person using a communications system at anotherlocation, the telepresence communication system. The system includes animage display device having an image area, the image area beingpositioned substantially within a vertical plane, the plane positionedfor viewing by the user in an observation zone. A two-way mirror ispositioned between the observation zone and the image display device andis angled to reflect a backdrop. The backdrop is positioned adjacent thetwo-way mirror so that the reflection of a left edge and a right edge ofthe backdrop in the two-way mirror substantially aligns with a left andright edge, respectively of the image display device when viewed fromthe observation zone. The system also includes a camera located in thebackdrop, such that the camera views the observation zone as areflection off the two-way mirror. The system further includes alight-absorbing panel positioned on the side of the two-way mirroropposite the camera and located in the view of the camera through thetwo-way mirror as the camera is aligned to view the reflection of theobservation zone off the two-way mirror.

In another aspect, embodiments provide for a telepresence technologiesconfiguration for allowing a user in a home location to see asubstantially life-size image of a person from a remote locationappearing directly ahead and achieving an apparent eye contact whileallowing for two-way interaction in real time for communication. Theconfiguration includes a first telepresence communications system tocapture the video image and audio of the person in a remote location anda remote location codec to encode outgoing video image and audio signalsand decode incoming video image and audio signals. The configurationfurther includes a network connection for transmission of two-waycommunication signals between the home location and the remote location.The configuration also includes a home location codec to decode incomingvideo and audio signals from the remote location and code outgoing videoimage and audio signals for transmission to the remote location todisplay an image of the person from the remote location on the imagedisplay device and project audio of the person from a speaker system.

In yet another aspect, embodiments provide for a telepresencetechnologies architecture for managing and facilitating telepresencecommunication for allowing a first user in a home location to see asubstantially life-size image of a second user at remote locationappearing directly ahead and achieving an apparent eye contact whileallowing for two-way interaction in real time for communication. Thetelepresence technologies architecture includes a telepresencecommunications system to capture a video image and audio of the seconduser using a pre-determined telepresence standard that definesrequirements for placement of a camera relative to a user and placementof said user. The telepresence communications system in the remotelocation includes a codec to encode outgoing video image and audiosignals and to decode incoming video image and audio signals. Thearchitecture further includes a network connection from the remotelocation to a telepresence operations center, the telepresenceoperations center including network connections to other remotelocations. Another feature of the architecture is a second networkconnection from the home location to the telepresence operations center,and a second codec in the home location to decode incoming video imageand audio signals of the second user and to code video image and audiosignals of the first user for transmission to the remote location viathe telepresence operations center. The architecture further includes asecond telepresence communications system in the home location,compatible with the pre-determined telepresence standard and configuredto display, substantially life-size, the incoming images and audiosignals of the second user in the home location.

Embodiments provide advantages over previous configurations thatsuperimposed a reflected image of a person into the three-dimensionalsetting of a room. Since the preferred embodiments allow for the directviewing of an image on an image display system, the image is notdegraded by a superimposed room background that could produce a ghosteffect. Some previous configurations of a reflected image of a personused a physical backdrop behind the superimposed image of thetransmitted person so that the room setting did not wash out the image.However, the requirement for a physical backdrop behind the image causedthe display system to be excessively bulky. In contrast, the embodimentsmay be compact since the backdrop is reflected to appear behind theimage on the image display system, which achieves the visual illusion ofdepth without requiring the actual physical depth. In this way, theembodiment of the invention is by comparison about half of the actualphysical depth. This is especially important in that a preferredphysical embodiment, as a fully functioning telepresence system, can beplaced on casters and rolled through a standard single doorway withoutrequiring any disassembly or folding up of the system.

Embodiments provide advantages over previous configurations that arebased on a direct view of an image display device through a beamsplitterwith a camera aligned for eye contact. In previous configurations thereflection in the beamsplitter may be the surface of a desk, table orfloor. In some cases, this reflection may include a black panel withouta specific relationship to the image display device. Embodiments mayincorporate a black panel that is positioned on the opposite side of thebeamsplitter at an equal distance from the image display device. As afurther improvement the left side and the right side of the black panelmay appear reflected to appear superimposed at the position of the leftand right side of the image display device respectively. By matching thesize and placement of the black panel to the size of the image displaydevice, the full image area of the image display device will beprotected from unwanted superimposed reflections while at the same timenot being any larger than necessary. In another aspect of embodimentsthe eye contact communications system can be placed on casters androlled through a standard single doorway without requiring anydisassembly or folding up of the system. In addition these embodimentsmay achieve the minimal size that is critical as a desktopcommunications system.

Another advantage of preferred embodiments is that the configuration canbe folded up to become even more compact when not in usage. This makesit possible for the communications system to be stored in a small space.

Furthermore, embodiments may have the unique advantage of incorporatinglighting behind the image display device to improve the communicationsexperience. This lighting may illuminate an area or a wall behind thecommunications system so that the area outside of the left and rightedges of the image display device will be brighter than the reflectedarea of the desk or floor to the left and right of the black panel. Inthis manner the user will clearly view the illuminated wall or roomsetting to the left and right edges of the image display device as abrighter image than the undesirable superimposed reflection of the deskor floor to the left and right of the black panel.

Another advantage of the present invention is that the backdrop can be abacklit transparency. Since this backdrop image is preferablyilluminated from behind, the brightness of the image will not beadversely affected by the ambient lighting in the room. The backlitilluminated transparency can be a graphic image, photographic image,montage or patterned surface that is optimal for brightness andcomposition to achieve the desired visual effect for the backdrop.

An embodiment could include the network connection, which could be overan ISDN network or an IP network. The output of the computer from thesend location could be directed through the codec to transmit a computerimage at the second image display device at the remote location.

Another aspect is the communication between two locations usingtelepresence communications systems. In this aspect, the systemarchitecture incorporates a network connection between computers in eachof the telepresence communication locations to establish interactionwith data sharing applications. For optimizing the quality of thedelivery of both the supporting computer generated visuals and theeffective delivery of the video images of the telepresence systems, itis preferable to use an IP network that is optimized for telepresence.This telepresence network would need to meet specific requirements of aminimal latency and quality of service, which may be better thantransmission on the public Internet.

In yet another aspect, embodiments provide for a telepresencetechnologies architecture that is connected by a telepresence network toa telepresence operations center. It would be possible to offertelepresence services from this telepresence operations center,including digital recording of incoming video and data presentations,playback of prerecorded sessions, chat room services and many otherservices. The customers connected to the telepresence operations centerwould be monitored and charged for the telepresence services delivered.

There are many advantages to the innovation of a telepresencetechnologies architecture comprised of telepresence communicationssystems connected by a telepresence enabled network to a dedicatedtelepresence operations center to deliver a variety of telepresenceservices. With this telepresence technologies architecture, thetelepresence operations center could have the capability of recordingpresentations since the incoming video signal and the visual supportingcontent will flow through the telepresence operations center. Thisrecorded video and saved visual display content could be digitallystored at the telepresence operations center for synchronized video anddata playback for future usage.

An advantage of the telepresence technologies architecture is that allof the communication would flow through the telepresence operationscenter so that it would be possible to monitor usage and delivery ofstored content. In this embodiment of the telepresence technologiesarchitecture, the company managing the telepresence operations centercould document usage and charge accordingly.

Another advantage of this custom telepresence technologies architectureis that each location will be connected to the telepresence operationscenter, which will make it possible to deliver either live orprerecorded visual content from the telepresence operations centerwithout any requirement to disconnect from one location and reconnect toanother location. This could be especially effective for educational andtraining applications where prerecorded lectures could be delivered toeducational facilities for the display of a life-size image of theinstructor with the synchronized display of supporting visual content.At the end of the prerecorded lecture, the lecturer could be transmittedfrom his or her telepresence communications system in their homelocation to the telepresence operations center where their transmissionwould, in turn, be transmitted to the receiving location for livetwo-way interaction for questions and answers. As part of a serviceprovided by the telepresence operations center a series of prerecordedlectures could be delivered to a number of locations at staggeredintervals so that the lecturer could be connected to appear at eachlocation consecutively at the end of the prerecorded lecture for a livesession with each location individually. In this manner the lecturercould have his or her time maximized by having a “presence” at eachlocation for two-way within a short amount of time. By way of example, a45 minute prerecorded lecture could be followed by a 15 minute livesession, which could be staggered so that the lecturer could complete atotal of four sessions of 45 minute lectures followed by 15 minute livequestion and answers interaction at different locations around the worldwithin a single hour. This capability is made practical and manageablewith the telepresence technologies architecture as defined in thisembodiment.

BRIEF DESCRIPTION OF THE DRAWINGS

The above features of the present invention will be more clearlyunderstood from consideration of the following descriptions inconnection with accompanying drawings in which:

FIG. 1 illustrates a prior art configuration displaying a reflectedimage of a person positioned in the line of sight of the observer tosimulate eye contact;

FIG. 2 illustrates a prior art configuration displaying a reflectedimage of a person with a camera in the background setting;

FIG. 3 illustrates a prior art configuration in a perspective view ofFIG. 2;

FIG. 4A illustrates a prior art configuration of a direct view of animage display device with a two-way mirror to reflect the camera view;

FIG. 4B illustrates a prior art configuration with a camera viewingtoward a two-way mirror that is angled to be along the line of sightwith a remote participant displayed on an image display device so thatthe camera captures an image of the participant with a perceived eyecontact;

FIG. 5A illustrates a first embodiment with an image of a person on animage display device at a first plane and a backdrop on a reflectedsecond plane and a line of sight of a user that is reflected in thetwo-way mirror to view toward a camera viewing through an aperture in apanel;

FIG. 5B illustrates a camera viewing through a two-way mirror to a blacksurface according to the embodiment of FIG. 5A;

FIG. 5C illustrates a user's angle of view from the top to the bottom ofthe image display device;

FIG. 5D illustrates the reflection in the beamsplitter of the view ofthe user with a black panel at a position and size to match thesuperimposed view of the image display device;

FIG. 5E illustrates the camera view through the beamsplitter to alight-absorbing surface at the position and size to be as small aspossible, and the camera view reflected off the beamsplitter;

FIG. 5F illustrates the camera view through the beamsplitter to alight-absorbing surface, and the camera view reflected off thebeamsplitter with a black panel at a position and size to match thesuperimposed view of the image display device;

FIG. 5G illustrates a camera viewing forward to a mirror angled toreflect the view upwards to the beamsplitter to reflect the view inalignment for perceived eye contact with user, and illustrates the angleof coverage of the observation zone;

FIG. 5H illustrates a laptop computer with a clip on embodiment of theeye contact display device;

FIG. 5I illustrates a computer monitor with a clip on embodiment of theeye contact display device;

FIG. 5J illustrates the clip on embodiment of the eye contact displaydevice folded up;

FIG. 6A illustrates a perspective view of FIG. 5C and FIG. 5E;

FIG. 6B illustrates a perspective view of FIG. 5D and FIG. 5F;

FIG. 6C illustrates a top view of FIGS. 5D, 5F, and 6B;

FIG. 6D illustrates a top view of FIGS. 5D, 5F, and 6B with back lights;

FIG. 7 illustrates an embodiment of the present invention with the frontedges of the sides of the enclosure of the image display device thatmatch to the reflected positions of extensions of the sides from thebackdrop at the reflected second plane to the reflected first plane;

FIG. 8 illustrates a system with a backdrop comprised of multiple levelsbetween the reflected first plane and the reflected second plane;

FIG. 9 illustrates a perspective view of FIG. 8;

FIG. 10 illustrates an embodiment of the present invention with thewidth of the backdrop matching the width of a black area positioned at asecond plane behind the first plane of the image on the image displaysystem;

FIG. 11 illustrates a top view of FIG. 10;

FIG. 12 illustrates a perspective view of FIG. 11;

FIG. 13A illustrates a side view of an embodiment of the presentinvention with three planes;

FIG. 14A illustrates a front view of the embodiment in FIG. 13A;

FIG. 15A illustrates a top view of the embodiment in FIGS. 13A and 14A;

FIG. 16A illustrates optimal viewing angles for observers;

FIG. 13B illustrates an embodiment as a self contained eye contactcommunications system on casters;

FIG. 14B illustrates a front section view of FIG. 13B;

FIG. 15B illustrates a top section view of FIGS. 13B and 14B;

FIG. 16B illustrates a top view of FIGS. 13B, 14B, and 15B viewed offaxis by an observer;

FIG. 17 illustrates a perspective view of the embodiment in FIGS. 13A,14A, 15A, and 16A;

FIG. 18 illustrates a front view of FIG. 17 with the side panels andlights folded inward;

FIG. 19 illustrates a side view with the side panels and lights foldedinward;

FIG. 20 illustrates the backdrop with the camera and codec rotated down;

FIG. 21 illustrates the overhead panel and additional panel rotateddownward;

FIG. 22 illustrates the two-way mirror rotated part way downward withthe sliding supporting component;

FIG. 23 illustrates the two-way mirror in a closed position with a coverof the overhead panel;

FIG. 24 illustrates the additional panel rotated upward to cover therest of the two-way mirror;

FIG. 25 illustrates the monitor enclosure rotated downward for shipping;

FIG. 26 illustrates a user's view of a system;

FIG. 27 illustrates the camera view of a system;

FIG. 28 illustrates the camera view through the two-way mirror to ablack panel;

FIG. 29 illustrates a side view of a system at a table;

FIG. 30 illustrates the folding up of the backdrop panel;

FIG. 31 illustrates the folding down of the two-way mirror;

FIG. 32 illustrates the folding in of the overhead black panel;

FIG. 33 illustrates a closed system with the potential of direct viewingon the image display system;

FIG. 34A illustrates an embodiment of the invention as a deskcommunications system;

FIG. 34B illustrates an embodiment of the eye contact communicationssystem as a workstation;

FIG. 34C illustrates an alternative version of FIG. 3B with the camerapositioned above the beamsplitter;

FIG. 35 illustrates the folding down of the two-way mirror;

FIG. 36 illustrates the folding down of the overhead black panel;

FIG. 37 illustrates the folding forward of an upper section of panel tocomplete a desktop surface and potential for direct viewing of the imagedisplay system;

FIG. 38A illustrates an embodiment that is small enough to be placed ona table or desk;

FIG. 38B illustrates a tabletop embodiment with eye contact;

FIG. 39 illustrates the folding down of the two-way mirror;

FIG. 40 illustrates the folding down of the overhead black panel fordirect viewing of the image display system;

FIG. 41 illustrates an embodiment of the invention with a large rearprojection image display system;

FIG. 42 illustrates the folding down of the backdrop;

FIG. 43 illustrates the folding down of the two-way mirror;

FIG. 44 illustrates the folding in of the black overhead panel;

FIG. 45 illustrates the usage of an embodiment of the invention with theimage of a person on the image display system at eye level;

FIG. 46 illustrates the overhead black panel folding down;

FIG. 47 illustrates the two-way mirror folding up;

FIG. 48 illustrates the lights folding up;

FIG. 49 illustrates the backdrop folding up;

FIG. 50A illustrates an embodiment of the invention as a kiosk with thebackdrop overhead;

FIG. 50B illustrates an embodiment as a commercial display;

FIG. 50C illustrates an embodiment as a module placed in a wall;

FIG. 50D illustrates an embodiment as a free standing kiosk;

FIG. 50E illustrates a front elevation view of FIG. 50D;

FIG. 51 illustrates a large scale embodiment of the invention with thebackdrop at the level of the floor;

FIG. 52 illustrates the turning of the two-way mirror to the oppositedirection;

FIG. 53 illustrates the usage of the communications system for bothtransmission and for view of a remote audience and a real audience;

FIG. 54 illustrates a front view of FIG. 53 with a second screen forsupporting visuals;

FIG. 55 illustrates an interactive panel for usage by the presenter;

FIG. 56A illustrates a side section view of an embodiment of theinvention with an image display device for presenting supportingvisuals;

FIG. 57A illustrates a front section view of the embodiment in FIG. 56A;

FIG. 58A illustrates a front elevation view of the embodiment in FIGS.56A and 57A;

FIG. 56B illustrates an embodiment with an integrated data displaymonitor;

FIG. 57B illustrates a front section view of FIG. 56B;

FIG. 58B illustrates a front elevation view of FIGS. 56B and 57B;

FIG. 59 illustrates a top section view of the embodiment in FIG. 56A;

FIG. 60 illustrates a top elevation view of the embodiment in FIG. 56A;

FIG. 61A illustrates a perspective view of the embodiment in FIG. 56A;

FIG. 61B illustrates a perspective view of FIGS. 56B, 57B, and 58B;

FIG. 62 illustrates a side elevation view of the embodiment in FIG. 56Awithout the second image display device;

FIG. 63 illustrates a side section view of an embodiment that ispositioned on a small table;

FIG. 64 illustrates configuration of a person with a hand raised in theview of a camera within an eye contact configuration with a displaydevice behind a two-way mirror and a camera in front of the two-waymirror placed on a desktop;

FIG. 65 illustrates a configuration of a person with a hand raised inthe view of a camera within an eye contact configuration with a displaydevice reflected in a two-way mirror and a camera behind the two-waymirror placed on a desktop;

FIG. 66 illustrates a user of the eye contact configuration of FIG. 64or FIG. 65 with distortion resulting from the close wide angle cameraview;

FIG. 67 illustrates a user of an eye contact arrangement as seen from acamera at a desirable distance;

FIG. 68 illustrates a user positioned at a desirable distance from aneye contact configuration;

FIG. 69 illustrates a user at an embodiment of the invention with thecamera at a desirable distance achieved through a double reflectionarrangement;

FIG. 70 illustrates the path of the camera view for the configurationillustrated in FIG. 69;

FIG. 71 illustrates the angle of view of the camera with the desiredcamera view capturing the user and the positioning of a computerkeyboard and monitor on a desktop;

FIG. 72 illustrates the location of a black panel above the two-waymirror and a black background behind the user;

FIG. 73 illustrates lights positioned to achieve desirable lighting ofthe user;

FIG. 74 illustrates a plan view of a preferred embodiment of theinvention;

FIG. 75 illustrates a plan view of a preferred embodiment of theinvention with supporting structures;

FIG. 76 illustrates a plan view of a preferred embodiment of theinvention with the location of lighting illustrated;

FIG. 77 illustrates an arrangement of workstations with desk structuresaligned horizontally;

FIG. 78 illustrates an arrangement of workstations with a backgroundpanel and the back of the alternating workstations aligned horizontally;

FIG. 79 illustrates an arrangement of trapezoidal shaped workstationsaligned to form a circle;

FIG. 80 illustrates an arrangement of trapezoidal shaped workstationsaligned to form a curving line;

FIG. 81 illustrates a telepresence technologies network configurationwith integrated data display;

FIG. 82 illustrates a telepresence technologies network configurationwith independent data sharing;

FIG. 83 illustrates a telepresence technologies architecture with anetwork connection to a central hub;

FIG. 84 illustrates an embodiment of the present invention with anasymmetric telepresence communications arrangement with an on-axiscommunications system with a camera aligned on axis for eye contact forcapturing an image with eye contact alignment and a network connectingto an off-axis communications system with a camera not obscured by atwo-way mirror for capturing an off-axis image of a user for two waycommunication;

FIG. 85 illustrates an embodiment of the present invention with thereceiving party viewing a perceived eye contact while the camera isoff-axis to eye contact and positioned in front of the two-way mirroralong with the image display device;

FIG. 86 illustrates an embodiment of the present invention with thereceiving party viewing a perceived eye contact while the camera isoff-axis to eye contact and viewing through a gap between the two-waymirror and the image display device;

FIG. 87 illustrates an embodiment of the present invention with thereceiving party viewing a perceived eye contact while the image displaydevice is behind the two-way mirror; the camera is above the two-waymirror; and a backdrop is reflected to appear behind the image on theimage display device;

FIG. 88 illustrates an embodiment of the present invention with thereceiving party viewing a perceived eye contact while the image displaydevice is behind the two-way mirror; the camera is below the two-waymirror; and a backdrop is reflected to appear behind the image on theimage display device;

FIG. 89 illustrates an embodiment of the present invention configured asa lectern with the camera and the image display device in front of thetwo-way mirror;

FIG. 90 illustrates an embodiment of the present invention configured asa lectern with the camera positioned forward of the two-way mirror andpositioned on the front of the monitor;

FIG. 91 illustrates an embodiment of the present invention configured asa lectern positioned on a platform with the camera located inside a mockpodium that is reflected in the two-way mirror;

FIG. 92 illustrates an embodiment of the present invention configuredfor the appearance of a head-to-toe image of a person to appear in athree dimensional setting with a camera positioned between a largetwo-way mirror and an overhead rear projection screen;

FIG. 93 illustrates an embodiment of the present invention configuredfor the appearance of a head-to-toe image of a person with a camerapositioned above a two-way mirror and a front projection screen below;

FIG. 94A illustrates an embodiment of the present invention configuredas a service counter with a camera positioned between the two-way mirrorand the overhead image display device;

FIG. 95A illustrates an embodiment of the present invention in FIG. 94with the two-way mirror rotated upwards to allow a person to work at theservice counter;

FIG. 94B illustrates an embodiment of the present invention configuredas a service counter with direct view of an image display device behinda two way mirror and a camera positioned between the two-way mirror withan overhead backdrop;

FIG. 95B illustrates an embodiment of the present invention in FIG. 94Bwith the two-way mirror and image display device rotated upwards toallow a person to work at the service counter;

FIG. 96 illustrates an embodiment of the present invention configured asa service counter with a camera between a two-way mirror and an imagedisplay device located below;

FIG. 97 illustrates an embodiment of the present invention configured asa service counter with a camera located above a two-way mirror with theimage display device positioned below and a keyboard and data monitorfor interaction with a user;

FIG. 98 illustrates an embodiment of the present invention positionedabove retail shelving with a camera positioned between a two-way mirrorand an overhead image display device;

FIG. 99 illustrates an embodiment of the present invention positionedabove an interactive computer based kiosk with a camera positionedbetween a two-way mirror and an overhead display device;

FIG. 100 illustrates an embodiment of the present invention configuredas a desk with a camera positioned between the two-way mirror and anoverhead image display device;

FIG. 101 illustrates an embodiment of the present invention configuredas a desk with a camera positioned between the two-way mirror and animage display device below;

FIG. 102 illustrates an embodiment of the present invention configuredas a desk with the camera positioned above the two-way mirror with theimage display device and a backdrop reflected in a position behind theimage display device;

FIG. 103 illustrates an embodiment of the present invention configuredas a desk with a small image display device behind a two-way mirror witha small camera above the two-way mirror and a backdrop reflected toappear behind the image display device;

FIG. 104 illustrates an embodiment of the present invention configuredas a conference table system with a camera located above a two-waymirror with an image display device located behind and a backdropreflected to appear behind the image display device;

FIG. 105 illustrates an embodiment of the present invention includingretail shelving with a camera positioned above the two-way mirror withan image display device behind and a backdrop reflected to appear behindthe image display device;

FIG. 106 illustrates a computer based kiosk embodiment of the presentinvention with a camera positioned above the two-way mirror with animage display device behind and a backdrop reflected to appear behindthe image display device;

FIG. 107 illustrates an automatic teller machine incorporating anembodiment of the present invention with a camera above a two-way mirrorwith an image display device behind and a backdrop reflected to appearbehind the image display device;

FIG. 108 illustrates an automatic teller machine incorporating anembodiment of the present invention with a camera above a two-way mirrorwith an image display device behind and a backdrop curving to meet thetwo-way mirror at an angle to give the appearance of a reflection of thebackdrop behind the image display device;

FIG. 109 illustrates a large scale embodiment of the present inventionwith a camera located above the two-way mirror with an image of a frontprojection screen and a backdrop reflected to appear behind the screen;

FIG. 110 illustrates a large scale embodiment of the present inventionwith a camera located above the two-way mirror with a rear projectionscreen behind and a backdrop reflected to appear behind the screen;

FIG. 111 illustrates a large scale embodiment of the present inventionwith a camera located above the two-way mirror with a front projectionscreen behind and a backdrop reflected to appear behind the screen;

FIG. 112 illustrates a large scale embodiment of the present inventionwith a camera located above the two-way mirror with a rear projectionscreen behind and a backdrop reflected to appear behind the screen;

FIG. 113 illustrates an embodiment of the present invention as a kioskor customer service counter with a surface at the level of the ceilingreflected into a plane of a wall behind;

FIG. 114 illustrates a front view of the embodiment in FIG. 113;

FIG. 115 illustrates an embodiment of the present invention in a roomwith the backdrop at floor level to appear reflected into a plane of awall behind; and

FIG. 116 illustrates a top view of the embodiment in FIG. 115.

DETAILED DESCRIPTION OF ILLUSTRATIVE EMBODIMENTS

Embodiments and their advantages will be discussed in general terms,first, followed by a more detailed description of specific preferredembodiments. The telepresence communications system is comprised of animage on an image display device, which is positioned directly behindthe two-way mirror. The image display device may be a flat panel plasmaor LCD monitor, rear projection video system, front projection on ascreen or other image display method capable of displaying movingimages.

The image display device has an image area, the image area beingpositioned substantially within a vertical plane, the plane positionedfor viewing by the user in an observation zone. A beamsplitter ispositioned between the observation zone and the image display device andis angled to reflect a black panel. The black panel is positionedadjacent the beamsplitter so that the reflection of a left edge and aright edge of the black panel in the beamsplitter substantially alignswith a left and right edge, respectively of the image display devicewhen viewed from the observation zone. The system also includes a cameralocated in the black panel, such that the camera views the observationzone as a reflection off the beamsplitter. The system further includes alight-absorbing panel positioned on the side of the beamsplitteropposite the camera and located in the view of the camera through thebeamsplitter as the camera is aligned to view the reflection of theobservation zone off the beamsplitter.

Embodiments provide for a telepresence technologies configuration forallowing a user in a home location to see a substantially life-sizeimage of a participant from a remote location appearing directly aheadand achieving an apparent eye contact while allowing for two-wayinteraction in real time for communication. The configuration includes afirst telepresence communications system to capture the video image andaudio of the participant in a remote location and a remote locationcodec to encode outgoing video image and audio signals and decodeincoming video image and audio signals. The configuration furtherincludes a network connection for the transmission of two-waycommunication signals between the home location and the remote location.The configuration also includes a home location codec to decode incomingvideo and audio signals from the remote location and code outgoing videoimage and audio signals for transmission to the remote location todisplay an image of the person from the remote location on the imagedisplay device and project audio of the person from a speaker system.

In another embodiment of the invention there is a depth relationship inthe telepresence system. For the purpose of clarity, the vertical planeof the image on the image display system is described as a first plane.A second plane is described as a plane parallel to the first plane andfurther away from the user. A backdrop is positioned further away fromthe two-way mirror than the image on the image display device so that areflection of the backdrop appears in the location of the second plane.The two-way mirror and the backdrop are set at angles that will resultin the reflection of the backdrop appearing in a vertical orientation tomatch the location of the second plane. The user in the observation zonewill see the superimposed images of the first plane comprised of theimage on the image display device appearing in front of the second planecomprised of the reflected image of the backdrop.

A camera is located in the backdrop, such that the camera views theobservation zone as a reflection off the two-way mirror. The cameracould be positioned behind the backdrop with a view through an aperturefor the lens to see through to the view of the reflection of theobservation zone off the two-way mirror. A reflective mirror could belocated behind an aperture in the backdrop in the view of the camera sothat the camera views the observation zone as a reflection off thetwo-way mirror and the reflective mirror.

A light-absorbing panel could be positioned on the side of the two-waymirror opposite the camera and located in the view of the camera throughthe mirror as the camera is aligned to view the reflection of theobservation zone off the two-way mirror. The light-absorbing panel couldbe a matt black fabric or other light-absorbing material to minimize theamount of light that would be superimposed with the view of thereflection of the view of the observation zone.

The camera could be positioned in the location where the view reflectedoff the two-way mirror would be approximately at the height of the eyelevel of a transmitted person appearing on the image of the imagedisplay device. In this way, the user looking at the eye level of thetransmitted image of the person on the image display device would belooking in the direction of the reflected camera.

A black area, such as a panel covered with black material, matching thewidth of the backdrop could be positioned in the location of the secondplane to match the superimposed image of the reflected backdrop. Thiswould result in a view of the reflection of a backdrop comprised of anilluminated visible material, which would be more clearly visible to theuser than the direct view of the black area. As a result, the user wouldsee the direct view of the image on the image display device on thefirst plane in front of the reflected backdrop on the second plane withthe backdrop and the two areas matching in width. Outside of the widthof the backdrop and the black area, the user would see a direct view ofthe room setting to the sides. Part of the view could include a viewthrough the two-way mirror to the room setting to the sides of thereflected backdrop. In this view, through the two-way mirror that isoutside of the reflected backdrop, the objects surrounding the backdropcould reflect in the two-way mirror. Therefore, it is advantageous tohave these objects, such as the supporting structure for the backdropand the surrounding floor, to be dark in color and not highlyilluminated.

The backdrop could be illuminated from the available room lighting orthe telepresence system could have integrated lights to illuminate thebackdrop. Alternatively, the backdrop could be comprised of a panel orpanels with a transparency or transparencies displaying photographic orgraphic images that are illuminated from behind. The backdrop could becomprised of one or more types of surfaces that in the reflected secondplane could have a mixture of colors, patterns, textures and/or anundulation or variation in depth within the surface area to producegreater depth cues relative to the superimposed image on the firstplane. Furthermore, the backdrop could have multiple planes extendingback from the reflected second plane to display additional depth cues.

The configuration could have the backdrop located below the two-waymirror. Alternatively, the configuration could have the backdrop locatedabove the two-way mirror. As a further alternative, the backdrop couldbe located to the side of the two-way mirror.

The image display device could have an exposed image area surrounded bya black enclosure to contain the image display device with the imagearea being positioned substantially within the first plane. The outeredges of the backdrop on the reflected second plane could be extendedtoward the two-way mirror to match the superimposed position of the leftand right sides of the black enclosure at the first plane.

The image display device with an exposed image area could be surroundedby a black enclosure containing the image display device. The image areacould be at the location of the first plane and the black enclosurewould have edges at the first plane. The black enclosure could also haveedges located at a second plane behind the first plane. The width of theblack enclosure at the second plane would be wider so that the left andright edges would be within the view of the user from the observationzone. The backdrop could be positioned further away from the two-waymirror to be at a location that is reflected into a position of a thirdplane parallel to the second plane and behind the second plane. The leftand right sides of the backdrop could extend from the reflected thirdplane to the reflected second plane. The locations of the left and rightextended edges of the sides of the backdrop could match the width of theblack enclosure at the second plane to superimpose within the view ofthe user from the observation zone. In this manner, the image displayedon the image display device on the first plane will be both in front ofthe left and right edges of the reflected backdrop at the second planeand, additionally, further in front of the middle of the backdropsuperimposed in the third plane.

An embodiment is compact enough that it can fit within a standard aislewidth in a store. This makes it ideal for usage in retail and commercialapplications as a kiosk, information booth or product promotionsdisplay. The free floating image in the communications system isexcellent for attracting attention to the life-size image of a person ina busy retail environment. It is also ideal for displaying floatinggraphic and product images for promotional purposes. The telepresencesystem could display prerecorded images of a life-size person tocommunicate messages or promote products. Alternatively, thetelepresence system could transmit a person from a commercially operatedtelepresence operations center to engage in two-way telepresencecommunication with people standing in the observation zone in front ofthe kiosk.

Some embodiments preferably provide a sense of presence of thetransmitted person, which can be very important for many businessapplications. In particular, banking applications can provide eyecontact between a banker and a customer. This eye contact is importantin maintaining trust and personal contact in the business relationship.The compact size of some embodiments makes them practical for uses inbanking locations which have limited space.

Embodiments may be scalable to a larger size, which is very importantfor communication with larger groups. In particular, embodiments candisplay a group of people while providing eye contact and a sense ofpresence in a three-dimensional setting. It can also provide a largeimage area for one person to move in freely. This can be very useful forteaching applications where the teacher may want to move at the front ofthe room. Embodiments may incorporate the display of presentations, dataand graphics to support the training, teaching or presentation activity.In some configurations the communications systems can be folded up intoa carrying case.

Embodiments may allow for the direct viewing of the room setting to theleft and right of the reflected backdrop. This assures that the imagedoes not appear to be at the back of a black box, which would be thecase if side panels enclosed the image display device behind the two-waymirror. In an embodiment, lights can be incorporated in the back of thebackdrop structure so that the room setting backdrop can be illuminated.This lighting of the background would assure that the observer would seethe depth cues of the room setting at a properly illuminated light leveland color temperature that is optimal for compatibility with theilluminated backdrop.

In some embodiments, the system can incorporate a second image displaydevice, such as a plasma screen, LCD monitor or other computer/videodisplay device. This second image display device can be positioned infront of the two-way mirror. The second image display device can displaycomputer data, PowerPoint presentations, video, computer graphics or anyother visual material that would be used to support the presentation ofinformation. This “presentation screen” could be controlled from theremote location by the presenter at the remote location. In this manner,the telepresent person would appear to be controlling the “presentationscreen” in the room with the observers. The sharing of visualinformation and data can make the communication much more effective formany applications. The presenter in the remote location can have animage display device in front of him or her. As he or she looks down atthe image display device, his or her transmitted image at the locationof the observers will be seen as the telepresent person looking in thedirection of the image display device in the room. In this manner, therelationship of the telepresent person and the display of visualinformation will have the correct orientation for natural and effectiveinteraction.

An embodiment could be placed on a table. The configuration could have ablack backdrop that would be ideal for the display of an incoming visualof a location where the person or people are appearing on a blackbackground. This will be common for the image of a remote location.However, the ideal configuration for a system dedicated to sending atransmission would be to have a black backdrop. This send system couldinclude a black background behind the presenter and could incorporatelights to achieve optimal illumination of the presenter.

The telepresence technologies architecture has the advantage of makingnew forms of face-to-face communications services possible. As anexample, a large embodiment of the telepresence technologiesarchitecture could encompass a vast number of telepresence users. Sincethe configuration could connect users through a telepresence operationscenter, it would be possible to quickly and effectively make connectionsbetween the telepresence users without separate dialing or inputting newIP addresses. This telepresence technologies architecture would make itpossible to establish chat rooms and introduction services for people tomeet face-to-face and get to know each other through natural humancommunication with eye contact and the personality revealed throughfacial expressions and body language. This could be especially valuablefor lifelike and life-size telepresence services offering dating andintimate communication.

Another example of a telepresence technologies architecture applicationis for interviews for employment. Currently, video conferencing isoccasionally used for interviews. However, video conferencing is notgenerally effective since the job applicant cannot make eye contact withthe employer and the two-way interaction is not a natural face-to-faceconfiguration. Furthermore, video conference services are notstandardized and have many complexities in establishing connectionsbetween different users. By contrast, the embodiment of this inventionin the telepresence technologies architecture solves these problems.Firstly, the telepresence display system would establish the correct eyecontact and sense of presence of the job applicant to appear in the roomwith the employer. Additionally, the telepresence technologiesarchitecture would resolve the problems of connectivity since all of thetelepresence users could be connected to the telepresence operationscenter for reliable and standardized delivery. Applicants could go toany location in the world that has a telepresence communications systemand be assured that their appearance in the room with the employer willmeet the specific requirements of eye contact and quality oftransmission.

A further example of the telepresence technologies architecture is anapplication in banking. Banks have tested video conferencing oncustomers and have found that customers have rejected videoconferencing. They have objected to being viewed by a camera and can notestablish trust with a banker that will not make eye contact. However,the telepresence technologies architecture could resolve these problemsby bringing a life-size banker into the bank office to meet at a tableto discuss banking with eye-to-eye contact. Most importantly, thecustomer could meet with the right person at their branch bank eventhough this bank manager may be located at the city headquarters. Thetelepresence technologies architecture could operate within the securenetwork of the bank for confidentiality of information. The bank couldoperate their own telepresence operations center as long as it meets thespecific technical requirements to deliver life-size communicationthrough telepresence.

Another example of the telepresence technologies architecture is theapplication of telepresence in the security field. Security companiesuse surveillance cameras to monitor activities in remote locations.However, they recognize that presence in a location is a deterrent topotential intruders. The usage of standard video conferencing would notprovide a deterrent to intruders, since the video display on a monitorwould not provide any sense of presence. However, the telepresencetechnologies architecture could overcome these problems. The display ofa life-size security guard appearing at the guard station could give aperson at the exterior of the property a realistic impression that areal guard was actually at the guard station. Through the configurationof the telepresence system networked to the telepresence operationscenter, it would be possible to deliver advanced and cost effectivesecurity services. Instead of having the real guard appearing at onelocation, it would be possible to have a prerecorded life-size image ofthe guard transmitted to numerous locations. Only when a predefinedsensor is triggered will the real guard be transmitted to the locationof the incident. Since the telepresence technologies architecture isconfigured to accommodate a central command of the telepresence network,the real guard could transmit to the site at the speed of light. As atelepresent person, the guard could look directly at any intruders witheye-to-eye contact at the location of the incident and couldelectronically control lights, doors and security measures at thelocation.

A further application of the telepresence technologies architecture isfor communication with deaf people. Video conferencing has been used forcommunication between people who are deaf since the deaf people can seeeach other for communication through signing. However, videoconferencing is not ideal for this application since it would be moreeffective with eye contact and interaction with a life-size person.Furthermore, video conferencing requires that each location is dialedindividually.

The telepresence technologies architecture overcomes these problems byproviding both the improved display of a person communicating throughsigning and completes the technical solution by connecting theparticipants through the telepresence operations center. A signingperson can connect to another signing person through the telepresenceoperations center for face-to-face communication.

A further advantage of the telepresence technologies architecture isthat a deaf signing person can connect to a signing interpreter throughthe telepresence operations center. The signing interpreter can have aface-to-face and life-size interaction for easy reading of the signingcommunication. The signing interpreter can provide a verbal translationfor a third party who may have an audio only connection to theinterpreter for two-way communication, which will be relayed to the deafperson. Alternatively, the third party could use a telepresencecommunications system connected to the telepresence operations center.The third party could see the deaf person and could hear the verbaltranslation provided by the interpreter.

Another advantage of the telepresence technologies architecture is thatit could support communication between people speaking differentlanguages. Participants would connect to the telepresence operationscenter with their telepresence communications systems where they will beconnected for face-to-face telepresence communication. Additionally aconnection will be made through the telepresence operations center to atranslator at a third location who will hear the voices of the twoparticipants. The translator could translate the speech of the firstparticipant and provide a translation for the second participant.Conversely, the second participant could have his or her speechtranslated by the translator and spoken to the first participant. Thetelepresence technologies architecture could facilitate this translationservice by providing the technical configuration to easily andeffectively connect people of different languages for telepresencecommunication. One of the advantages of the telepresence technologiesarchitecture is that the participants can have natural face-to-facecommunication that would make it easier for them to establish rapportthrough facial expressions and body language.

The telepresence technologies architecture could provide furtheradvantages by integrating a speech to text capability that would bespecifically configured to have the translator's verbal translationcaptured by a speech to text software and then have the resulting textappear on the second image display device on the telepresencecommunications system or as superimposed text over the image of thetelepresent person. This innovation would allow the participants tomaintain communication with the other participant by looking forward tothe participant while at the same time seeing the written translation.In this embodiment of the invention, the participants may not need tohave a verbal translation, since their translation would be visuallypresented for them within the visual display. In this manner, they couldconcentrate on the personal interaction with the telepresent personthrough eye contact and body language.

As language translation software is refined, it would be possible tohave language translation software applications at the telepresenceoperations center that would be available to telepresence users. Thesoftware would eliminate the need for a translator as a third party. Afirst participant would speak in a first language, which would beinterpreted and translated to a second language for the secondparticipant. An important advantage of the telepresence technologiesarchitecture is that neither of the participants would need to haveeither the language translation software at their locations. Thissoftware and the technical means to facilitate this capability would beintegral to the services of the telepresence operations center.

Referring now to the drawings, wherein like reference numbers are usedto designate like elements throughout the various views, severalembodiments of the present invention are further described. The figuresare not necessarily drawn to scale, and in some instances, the drawingshave been exaggerated or simplified for illustrative purposes only. Oneof ordinary skill in the art will appreciate the many possibleapplications and variations of the present invention based on thefollowing examples of possible embodiments of the present invention.

FIG. 5A shows an embodiment with a displayed image 17 located at a firstplane which is viewed by an observer 3 through a two-way mirror 2. Apanel 8 may be positioned below the two-way mirror 2 at any distance.The panel 8 may be a black panel that may minimize light beingsuperimposed on the direct view of the image display device 4 as viewedby the observer 3 or may wholly prevent light from being superimposedimage. Also, the panel 8 may be a light colored or illuminated backdropthat is viewed as a reflection 9 at a second plane by the observer 3.The panel 8 may be positioned further away from the two-way mirror 2than the image 17 on the image display device 4. In this situation, if alight colored or illuminated backdrop is used, the reflected backdrop 9at the second plane will be seen by the observer 3 to appear to bebehind the image 17 on the first plane.

The image display device 4 may be a plasma monitor, LCD monitor, LEDmonitor, OLED monitor, rear projection screen or another device capableof displaying a video generated image. A beamsplitter is typically apartially silvered transparent substrate, which could be glass, plastic,Mylar or other transparent material. A beamsplitter has also beenreferred to as a one-way mirror, two-way mirror or a semi-transparentmirror. The beamsplitter may typically have a reflectivity of 30% to50%. The beamsplitter 2 is positioned in the configuration so that thesurface with the reflectivity is on the side with the user 3. Theopposite side of the beamsplitter may have an anti-reflective surfacethat may reduce the natural reflectivity of the clear surface.

FIG. 5A further shows the line of sight 220 of the user 3 as it isdirected toward the image display device 4. The line of sight 220 ispartially reflected off the beamsplitter 2 in the direction of 221toward the camera 1. The lens of the camera 1 views through the panel 8.The camera 1 may be placed behind the panel 8 with an aperture 29 forthe lens to view through so that the camera 1 is not clearly visible tothe user 3. A black panel 16 is placed above the two-way mirror 2 sothat the camera view through the two-way mirror 2 does not superimposeany light into the reflected view of the observation zone surroundingthe observer 3.

FIG. 5B shows the embodiment in FIG. 5A with a camera 1 viewing upwardsalong a line of sight 222 that partially passes through a beamsplitter 2to a light-absorbing surface 16, such as a black surface. Without thislight-absorbing surface 16 the camera 1 would be exposed with theilluminated area above the beamsplitter 2, which would superimpose intothe reflected view of the observation zone of the user 3. The remoteparticipant displayed on the image display device may appear life-sizeor close to life-size so that the eyes of the displayed participant maybe located close to the line of sight 220.

FIG. 5C shows the view of the user 3 in the direction 223 to the top ofthe image display device 4 and in the direction of 225 to the bottom ofthe image display device 4. This view passes through the beamsplitter 2.FIG. 5C further shows the view of the user 3 in the direction 223 towardthe top of the image display device 4 as it is reflected in thebeamsplitter 2 in the direction 224 toward the panel 8, and the view ofthe user 3 in the direction 225 toward the bottom of the image displaydevice 4 as it is reflected in the beamsplitter 2 in the direction 226toward the panel 8. In this illustration the beamsplitter 2 is movedclose to the bottom edge of the image display device 4, which is somedistance from the edge of the panel 8. If a color or illuminatedbackdrop is used for the panel 8, this configuration allows the user 3to view the reflected backdrop 9 at the second plane behind the image 17on the first plane. The camera 1 may be hidden behind the panel 8,except for an aperture 29 for the camera lens.

FIG. 5D shows the view of the user 3 in the direction 227 toward the topof the image display device 4 as it is reflected in the beamsplitter 2in the direction 228 toward a panel 8, and the view of the user 3 in thedirection 229 toward the bottom of the image display device 4. In thisillustration the beamsplitter 2 is moved close to the bottom edge of theimage display device 4, which intersects with the edge of the panel 8.The plane of the panel 8 is positioned a distance from the reflectivesurface of the beamsplitter 2 that is equal to the distance between thebeamsplitter 2 and the image plane 17 of the image display device 4.This configuration keeps the size of the panel 8 to a minimum whileproviding a direct view of the image display device 4. Any superimposedimage in this embodiment may be on the same plane as image 17, however,if a black panel is used as the panel 8, few or no unwanted superimposedreflections may occur in this area. The camera 1 may be hidden behindthe panel 8, except for an aperture 29 for the camera lens.

FIG. 5E shows an embodiment similar to FIG. 5A through FIG. 5D, exceptthat the light-absorbing panel 16 is positioned in the configuration tobe as small as possible for the purpose of keeping the overall eyecontact communications system to a smaller size. In particular, thelight-absorbing panel 16 is close to the image display device 4 whilenot covering the image area 17 of the image display device 4. The panel16 extends horizontally to the intersection with the beamsplitter 2.

The camera 1 views in the direction of 230 toward the front of theoverhead light-absorbing surface 16 and in the direction of 232 towardthe back of the light-absorbing surface 16 with this view passingthrough the beamsplitter 2. The directions of 230 and 232 illustrate apossible field of view of the camera 1. If the field of view of thecamera 1 would be wider than the direction 232, the camera 1 would viewthe monitor 4. This view wider than the direction 232 would beundesirable as the view of the monitor 4 would superimpose with thereflected view in the beamsplitter 2 of the observation zone of the user3. The view wider than the direction 230 would be undesirable as theview would capture an image beyond the edge of the beamsplitter 2.Therefore, the angle of view between the direction 230 and the direction232 would be defined as the widest angle of view that would be desirablefor this configuration. In order to take advantage of this full angle ofview it would be necessary to have a fixed lens for the camera 1 thatmatched this angle of view or a zoom lens that could be set to thisangle of view. A lens with a less wide angle of view or a zoom lens witha setting at a more narrow angle would fill the requirements forachieving a desirable reflected view off the beamsplitter 2 of theobservation zone of the user 3 while having the full image areaprotected from unwanted superimposed images as it views through thebeamsplitter 2 to the light-absorbing panel 16.

FIG. 5E also shows the view of the camera 1 with the maximum angle ofview as it is reflected off the beamsplitter 2. The front of the cameraview in direction 230 reflects off the beamsplitter 2 in the direction231. The back of the camera view in the direction 232 reflects off thebeamsplitter 2 in the direction 233. The camera view between thedirection 231 and direction 233 covers the observation zone of the user3. Any angle of view that is less than wide angle of view defined by thedirection 231 and direction 233 may be acceptable.

FIG. 5F shows an embodiment similar to FIG. 5E, except that the panel 8is positioned in the configuration to be as small as possible for thepurpose of keeping the overall eye contact communications system to aminimal size. In particular, the panel 8 is close to the monitor 4 whilenot covering the image area 17 of the image display device 4. The panel8 extends horizontally.

The camera 1 views in the direction of 234 toward the front of theoverhead light-absorbing surface 16 and in the direction of 236 towardthe back of the light-absorbing surface 16 with this view passingthrough the beamsplitter 2. The directions of 234 and 236 illustrate apossible field of view of the camera 1. If the field of view of thecamera 1 would be wider than the direction 236, the camera 1 would viewthe monitor 4. This view wider than the direction 236 would beundesirable as the view of the monitor would superimpose with thereflected view in the beamsplitter 2 of the observation zone of the user3. The view wider than the direction 234 would be undesirable as theview would capture an image beyond the edge of the beamsplitter 2.Therefore, the angle of view between the direction 234 and the direction236 would be defined as the widest angle of view that would be desirablefor this configuration. In order to take advantage of this full angle ofview it would be necessary to have a fixed lens for the camera 1 thatmatched this angle of view or a zoom lens that could be set to thisangle of view. A lens with a less wide angle of view or a zoom lens witha setting at a more narrow angle would fill the requirements forachieving a desirable reflected view off the beamsplitter 2 of theobservation zone of the user 3 while having the full image areaprotected from unwanted superimposed images as it views through thebeamsplitter 2 to the light-absorbing panel 16.

FIG. 5F also shows the view of the camera 1 with the maximum angle ofview as it is reflected off the beamsplitter 2. The front of the cameraview in direction 234 reflects off the beamsplitter 2 in the direction235. The back of the camera view in the direction 236 reflects off thebeamsplitter 2 in the direction 237. The camera view between thedirection 235 and direction 237 covers the observation zone of the user3. Any angle of view that is less than wide angle of view defined by thedirection 235 and direction 237 may be acceptable.

The camera view in the foregoing FIG. 5A through FIG. 5F will be amirror image since it is reflected once off the beamsplitter 2. Thiscamera image will show the observation zone with the incorrectorientation unless the image can be inverted in the camera, a separatevideo mixer or the transmission codec. For this reason it is not alwayspractical to use standard cameras and codecs. However, there are somecodecs that have a feature to flip the video image.

FIG. 5G shows the camera 1 positioned to view forward in a horizontaldirection 238 toward a mirror 42. This mirror 42 may be a front surfacemirror to eliminate the problem of a partial reflection off the glasssurface of a standard mirror where the reflective surface is on the backof the glass panel. Another embodiment is to incorporate a prism with amirrored surface. The prism may have one surface mirrored so that a viewin one side of the prism would reflect off the mirrored surface. Theadvantage of the usage of a mirrored prism is that no dust or damagecould reach the mirrored surface. Another approach for keeping the dustfrom settling on the front surface mirror 42 is to cover the opening inthe black panel with an anti-reflective glass panel 248. Anti-reflectiveglass has special coatings to minimize the normal reflectivity ofstandard clear glass. This configuration of the camera 1 and the mirror42 may be incorporated into any of the previous embodiments.

The view forward in horizontal direction 238 is reflected off the mirror42 in the direction 239 toward the beamsplitter 2, which is reflected inthe direction 240 toward the user 3. The view in the directions 241 and244 of the camera 1 is reflected in the mirror 42 with the front of thecoverage in the direction 242, which is a reflection of direction 241,reflected in the beamsplitter 2 in the direction 243, and the back ofthe coverage in the direction 245, which is a reflection of direction244, reflected in the beamsplitter 2 in the direction of 246. The cameraview between the directions of 243 and 246 covers the observation zoneof the user 3. The camera view between directions 242 and 245 partiallypasses through the beamsplitter 2 to view the light-absorbing panel 16.

It is important to note that the configurations as shown in FIGS. 5Athrough 5G could be flipped vertically with the beamsplitter 2 angled inthe opposite direction so that the camera 1 would be at the top and thelight-absorbing surface 16 would be on the bottom.

FIG. 5H shows a laptop computer 380 with an embodiment of the eyecontact image display device comprised of a beamsplitter 2 with a camera1 positioned below in a black backdrop 8 and an overhead black panel 16.The camera 1 may be a webcam or other small image capture device whichviews upwards along a line of sight 222 which is reflected off thebeamsplitter 2 along the line of sight 220 toward the user 3. When theuser 3 looks at the image display device 17 it will be along the sameline of sight 220 to achieve a perceived eye contact with a personappearing on the image display device 17. The panels of the overheadpanel 16, beamsplitter 2 and backdrop 8 are connected together tocomprise a Z shaped component that is held at the top of the laptopmonitor 380 by a locking mechanism 381. This locking mechanism 381 maybe Velcrow, DuoLock or other components that easily lock together. Thisembodiment has the advantage of achieving eye contact with a simpledisplay unit that can be easily clipped onto a laptop computer.

FIG. 5I shows a computer monitor 69 with an embodiment of the eyecontact image display device comprised of a beamsplitter 2 with a camera1 positioned below in a black backdrop 8 and an overhead black panel 16.The camera 1 may be a webcam or other small image device which viewsupwards along a line of sight 222, which is reflected off thebeamsplitter 2 along the line of sight 220 toward the user 3. The devicemay be held in position with a locking device.

FIG. 5J is the embodiment of FIGS. 5H and 5I folded up comprised of thecamera 1, backdrop 8, beamsplitter 2 and overhead panel 16. The foldedeye contact display system could be constructed of lightweight metal,such as aluminum, or a lightweight plastic. The folded unit could besmall enough to fit into a computer carrying case or small shippingcontainer.

FIG. 6A shows a perspective view of the configuration in FIG. 5C andFIG. 5E. The image 7 of the person from the remote location is vieweddirectly through the two-way mirror 2. Since the image display area 17is behind the two-way mirror, there is not the problem of the prior artFIG. 3, which had the distraction of the direct view of image 7 on theimage display system. The image 7 of the remote person is preferablyproduced with a black background so that the surrounding frame 5 is notvisibly illuminated. A camera 1 is placed in the panel 8. The reflectedcamera view 15 is in the line of sight of the displayed person 7 fromthe remote location. The camera view through the two-way mirror 2 isabsorbed by an overhead black panel 16. The black panel 16 allows thecamera to view the reflected observation zone surrounding the observer 3without superimposing any light from the view through the two-way mirror2.

Since the image display area 17 is viewed directly through the two-waymirror, the image 7 is clear and undistorted. With the prior art FIG. 3,any imperfections in the mirror would distort quality of the reflectedimage. This is particularly critical when the two-way mirror is on aplastic or Mylar substrate. By contrast, a slight imperfection in thereflection of a backdrop is not as critical as the focus of attention onthe transmitted person 7. Another problem with the view of a reflectionof an image in the prior is that the two-way mirror could introduce acolor shift. However, the direct viewing through the two-way mirror isless prone to a color shift.

A light colored or illuminated backdrop, which is used as the panel 8below the two-way mirror, is viewed by the observer 3 as a reflectionthat appears to be located at the second plane behind the first planewith the image of the transmitted person 7 on the image display device.Therefore, there is an obvious depth relationship between the image ofthe transmitted person 7 and the reflected backdrop 9. This achieves thedesired three-dimensional relationship that can produce a greater senseof presence.

The panel 8 may have a pattern, texture or graphic design in order toprovide depth cues for the observer 3 to clearly see the displayed imageof the transmitted person 7 as being in front of the reflected backdrop9. The backdrop may comprise a pattern of planes at different depths sothat the displayed person is viewed relative to a three-dimensionalsetting appearing behind the person. The camera 1 could be incorporatedinto the back of the panel 8 so that it is in the line of sight for eyecontact.

Since the reflected backdrop 9 and the displayed person 7 are viewed astwo superimposed images, it is particularly advantageous that thebrightness of the panel 8 is controlled. In preferred embodiments ofthis invention, the backdrop 8 is produced specifically to provide thecorrect level of brightness to effectively achieve the desired visualeffect of a three-dimensional relationship of the displayed person 7relative to the reflected backdrop 9. The backdrop 8 may be darkrelative to the image of the person 7 so that it does not appear throughthe person 7 to cause a “ghost” effect. However, it may be bright enoughto be clearly visible for the purpose of providing the depth cue of athree-dimensional setting relative to the person 7. Also, it may bebright enough to obscure the black portion of the screen surrounding theimage of the remote person 7. In these ways, the backdrop achieves thedesired telepresence effect.

The size of the backdrop 8 may be large enough to cover the full area ofthe image display device. Since the image display device 17 is viewed ona first plane in front of the reflected backdrop 9 on a second plane, aview somewhat to the side, instead of directly from the center of thescreen, may require that the backdrop 8 is larger than the image displayarea 17. Otherwise, the backdrop might not be large enough to cover thefull image of the image display device when viewed by an observerlocated off to the side.

Outside of the reflected view of the backdrop 9 will be a reflected viewof the area surrounding the backdrop 18. In some cases, this reflectionmay be a view 18 of the floor and objects on the floor. This reflectedimage on the two-way mirror 2 of the surrounding area 18 may bedistracting and undesirable if it is light enough to be viewed clearlyas a reflection. For this reason, it is preferred that the table,supporting equipment and floor surrounding the backdrop 8 are dark invalue and are not brightly illuminated.

FIG. 6B shows a perspective view of another embodiment similar to FIGS.5D and 5F. The user 3 views the image display device 4 through thebeamsplitter 2. The camera 1 is positioned behind a black panel, whichis the panel 8 in this embodiment, with only the lens exposed. Theopening for the camera lens should be black so that it is not visible asa reflection in the beamsplitter. However, for this illustration thereflected lens 251 is shown in its position reflected in thebeamsplitter 2 as a superimposed image with the image of a participant252 transmitted from a remote location.

The plane 17 of the image display surface of the image display device 4,the plane of the top surface of the black panel 8 and the plane of thefront semi-reflective surface of the beamsplitter 2 converge into asingle line. The angle between the plane of the front surface of theblack panel 8 and the plane of the front semi-reflective surface of thebeamsplitter 2 is equal to the angle of the plane of the frontsemi-reflective surface of the beamsplitter 2 and the plane of the imagedisplay surface 17 of the image display device 4.

The right edge of the image display device 258 matches in the reflectionin the beamsplitter with the right edge 259 of the panel 8. The leftedge of the image display device 259 matches with the reflection of theleft edge 255 of the panel 8.

The area behind the image display device 4 may be more brightlyilluminated than the table surface 256 or the floor 257 so that the viewof the room setting is more visible through the beamsplitter 2 than thesuperimposed reflection of the desk 256 or floor 257.

FIG. 6C is a top view of the eye contact communications system shown inFIG. 6B. The width of the panel 8 matches the width of the image displaydevice 4. The image display device right edge 258 is aligned with theblack panel right edge 254 and the image display device left edge 259 isaligned with the black panel left edge 255.

FIG. 6D is another view of FIG. 6C with the addition of lights 261 and awall surface 260. Placing the system close to a wall positions the imageplane of the image display device 4 close enough to the wall 260 toprovide a sense of a continuity of the image plane of the image displaydevice expanding to the plane of the wall 260. This visual impressionmay be accentuated by illuminating the wall 260 behind the image displaydevice 4 with a color that matches the background color displayed on theimage display device. As an example, the remote location for thedistance communication may video the users against a blue backdrop. Whenthis video image with the blue background is displayed, it may beadvantageous to illuminate the wall behind the image display device withblue lighting.

FIG. 7 shows a black enclosure 58 containing an image display devicewith the exposed image area 17 viewed through the two-way mirror 2 bythe observer 3. The image 17 is located at a first plane. A backdrop 24is reflected in the two-way mirror 2 to appear as a reflected image 25at a second plane. The left and right edges 20 of the backdrop extendtoward the two-way mirror 2 to a position that is viewed as a reflectionin the two-way mirror at the first plane to match the left and rightfront edges of the image display enclosure 58.

FIG. 8 shows multiple levels 22 of the backdrop between the front edge20 and the back of the backdrop 24. This pattern may be used toestablish a greater sense of depth as the backdrop is viewed as areflected image extending from the first plane to the second plane 25.The steps back (i.e., the multiple levels) 22 may become smaller as theyextend back to the second plane 25. In this way it may create aforeshortening effect, similar to that used in theatrical stage sets tocreate an increased sense of depth.

FIG. 9 is a perspective view of FIG. 8. In this illustration, the sideof the black enclosure of image display device 58 matches the side ofthe backdrop 26. As viewed from any angle in front of the two-way mirror2 the superimposed edges will match. In this way, the view of the fullarea of the image display enclosure 58 will be matched with thesuperimposed images of backdrop surfaces 20, 22 and 24 and the image ofa person 7 within the image display area 17. The image of the person 7on the first plane will appear to be in front of the reflected backdropon the second plane 25, which will achieve a three-dimensional visualeffect.

Another advantageous feature of this configuration is that the area tothe left and the right of the black enclosure of image display device 58will be visible through the two-way mirror 2 to the three-dimensionalroom setting 12. The area 19 outside of the backdrop area may be blackso that it does not superimpose light to the view of the room setting 12as the area 19 is seen as a reflection in the two-way mirror 2. The user3 may also see a reflection of the floor in the two-way mirror 2.However, the floor may be dark and the room setting 12 may be light sothat only the room setting 12 is visible in a view through the two-waymirror 2. Since the room setting 12 is seen through the two-way mirror2, the sense of presence of the person 7 is enhanced by viewing thetransmitted person 7 in the context of the depth cues of both a backdropand a three-dimensional room setting.

Light objects 10 in the room setting will not adversely affect thequality of the image 7 of the transmitted person since the light object10 is blocked by the image display enclosure 58. The superimposed imageof the reflected backdrop 25 matches to the position of the imagedisplay enclosure 58 to provide the optimal brightness for the displayof the image 7 while allowing the observer 3 to clearly see the objects10 appearing to the side of the image display enclosure 58. In thismanner, the observer 3 gains a perception of the three-dimensionalsetting of the room while having the controlled display of the image 7against the superimposed image 25 of the backdrop.

The sides 26 of the backdrop may be a depth that will equal the depth ofthe sides 27 of the image display enclosure 58. In this way, the actualphysical dimensions of the image display enclosure 58 will match thereflected backdrop in the superimposed view of both. This depth of thesides 26 and 27 may be minimal, such as 3″ to 4″ for the front portionof a rear projection television monitor or the depth of a plasmamonitor.

In FIG. 10, a black panel 28 is physically located in a second planebehind or on the back of the image display enclosure 58. The exposedexterior of the image display enclosure 58 (other than the actual imagedisplay area 17) is preferably covered in a matt black surface to absorblight and minimize reflections. The black panel 28 is located the samedistance away from the two-way mirror 2 as the backdrop 30 so that thereflection of the backdrop appears in the second plane to match to theposition of the black panel 28.

In this illustration, an optional pair of protrusions 32 is positionedso that their reflection on the two-way mirror 2 matches the first planeof the front two edges 59 of the image display enclosure 58. Theprotrusions 32 reflect in the two-way mirror 2 to appear to be on thefirst plane in front of the reflected backdrop 28 on the second plane.Since the protrusions 32 match the perceived positions of the sides 59of the image display enclosure 58, the reflection masks the edge 59 ofthe black enclosure image display device 58 from the observer 3. Theprotrusions 32 preferably contain lights that illuminate the backdrop 30(and hence provide a controlled illumination of the backdrop 30 toachieve the preferred brightness to appear superimposed with the image17).

FIG. 11 shows a plan view of FIG. 10. The backdrop 30 is the same widthas the black panel 28 so that the reflection of the backdrop 30 in thetwo-way mirror 2 appears in the second plane to match the width of theblack panel 28. The pair of protrusions 32, preferably containinglights, is positioned above the backdrop 30 in a location matching thewidth of the image display enclosure 58 at the front edges 59. The blackpanel 28 on the second plane is wider than the width of the image area17 on the first plane so that an observer 3 would see the image area 17contained within the width of the black panel 28 while viewing the depthrelationship of the image area 17 on the first plane in front of thereflected backdrop in the position of the black panel 28.

An observer 38 located off to a side of the central axis could view theimage area 17 on the first plane shifted to one side relative to theblack panel 28 on the second plane. The observer 38 views from aposition where the line of sight 63 passes the front edge 59 of theimage display enclosure 58 on the first plane and also passes the rightedge of the black panel 28 on the second plane. The observer 38 can viewthe three-dimensional depth cues of objects in the room setting, such asan object 65 close to the edge of the black panel 28. An observer 39 islocated further to the side of the central axis and has a line of sight64 that passes the front edge 59 of the image display enclosure 58 onthe first plane. However, from the position of the observer 39 a portionof the view of the room setting close to the right edge of the blackpanel 28 on the second plane is blocked by the image display enclosure58. From the position of observer 39 the object 65 would be blocked fromview. Since the backdrop 30 is viewed as a reflection in the secondplane at the width of the black panel 28, the observer 39 will see aportion of the view from the right edge of the reflected backdrop 30 tothe line of sight 64 passing the right edge 59 as a section of the imagedisplay enclosure 58. This is an undesirable effect since the observer39 would miss the view of some depth cues, such as an object 65. Itwould be possible to increase the width of the black panel 28 and thecorresponding width of the backdrop 30, but this would decrease the viewof the background. Therefore, it is logical to determine an optimalviewing angle for observers with the understanding that viewing fromoutside of this range of viewing would result in an undesirable visualeffect.

FIG. 12 is a perspective view of FIGS. 10 and 11. The advantage of thisconfiguration is that the appearance of the remote person 7 would not becontained within a box with sides matching to the front edge 59 of theimage display enclosure 58. The image of the transmitted person 7 wouldappear to be on a first plane in front of the reflected backdrop 21 on asecond plane and within the context of the room setting 12.

FIG. 13A shows an embodiment with the displayed view for the observer 3comprising three planes. The closest plane is the first plane with theimage 17 displayed on the image display device. Protrusions 32incorporating lights are located in front of the two-way mirror 2 in aposition to be reflected as superimposed reflections on the first plane.The second plane is behind the first plane at the location of the backedge 35 of the image display enclosure 58. The middle portion of thebackdrop 36 reflects in the two-way mirror 2 at a location 37 furtherbehind the second plane for the location of the third plane. In thisembodiment, the backdrop has sides 31 that extend from the backdropmiddle section 36 on the reflected third plane to the front edges of thesides 34 which match to the location of the reflected second plane. Thewidth of the image display enclosure 58 at the back edges 35 on thesecond plane is the same as the width of the backdrop at the edges ofthe sides 34 reflected on the second plane. Both the back edges 35 andthe backdrop edges 34 appear superimposed at the same location of thesecond plane. To the left and right of the area comprised of the imagedisplay enclosure 58 and the backdrop 36 and backdrop sides 31, theobserver will see through the two-way mirror 2 to the room settingbehind. In the area of the superimposed images of the image displaydevice and the backdrop the observer will see three planes, comprised ofthe first plane of the image 17 on the image display device, the secondplane of the matched edges of the back edge 35 of the image displayenclosure and the forward edge 34 of the backdrop sides 31 and furtherback to a third plane formed by the back of the backdrop 36 viewed as asuperimposed reflection in the location 37. The embodiment has a camera1 and codec 40 positioned below the backdrop 36. The camera 1 views areflection off a mirror 42 and sees through an aperture 29 in thebackdrop 36. The two-way mirror 2 is held by a rod 49 that is supportedby a diagonal structural member 56.

FIG. 14A illustrates a front view of the embodiment in FIG. 13A. Theprotrusions holding the lights 32 are positioned at the same width asthe front edges 59 of the image display enclosure 58. When viewed as areflection on the two-way mirror 2 the protrusions 32 will appearsuperimposed on the first plane over the front edges 59 of the imagedisplay enclosure 58, which may help to obscure a direct view of thefront edges as seen through the two-way mirror 2. Behind the first planeat the locations of a second plane is the back edge 35 of the imagedisplay enclosure 58 and the reflected view of the top edge 34 of thesides 31 of the backdrop. Further, behind is a third plane comprised ofthe reflected view of the back of the backdrop 36. A camera 1 and codec40 are located below the backdrop 36 on a shelf 41.

FIG. 15A illustrates a top view of the embodiment illustrated in FIGS.13A and 14A. This illustration shows the depth relationships of thethree planes. The first plane is at the location of the image area 17displayed on the image display device 57. The second plane is furtherbehind at the location of the back edges 35 of the image displayenclosure 58. The third plane is the furthest back at location 37, whichis the reflected view of the middle of the backdrop 36. The camera 1 andcodec 40 are located below the backdrop 36. The camera views areflection off a mirror 42 and sees through an aperture 29.

FIG. 16A illustrates the same top view of FIG. 15A with the addition ofsight lines for observers. Observer 38 has a line of sight 63 thatpasses by the front edge 59 of the image display enclosure 58 and backedge 35 of the image display enclosure 58. Observer 66 on the oppositeside has a line of sight 68 which also passes the front edge 59 and backedges 35. The preferred angle of view 67 has optimal viewing of thevisual effect. In this illustration, the lines of sight 63 and 68 areeach 45 degrees off the central axis for a total preferred viewing angleof 90 degrees.

FIG. 13B shows an embodiment that is contained within a free standingstructure 270 with minimized light being superimposed. This structure270 may take the form of a cart with casters 50. The panel 8, which is ablack panel in this embodiment, may be at a height close to the heightof the table 33. If the structure 270 was positioned close to the table33, it could appear to be an extension of the table. The total depthfrom front to back of the structure 270 may be less than the width of astandard single doorway. The user 3 may sit at a separate table 33. Theuser 3 may view forward along a line of sight 220 to view the display ofa remote participant appearing to be life-size at eye level on the imagedisplay device 4. This line of sight will be reflected on thebeamsplitter 2 in the direction 221, which will be reflected on themirror 42 in the direction 238 to the camera 1. This embodiment achievesa minimal physical size while providing eye contact.

FIG. 14B shows a front section view of the eye contact communicationssystem structure 270 of the embodiment in FIG. 13B. The camera 1 ispositioned below the black panel 8. The image display device 4 is behindthe beamsplitter 2. The beamsplitter 2 may be wider at the top than atthe bottom. The black panel 8 may be a width that matches the width ofthe image display device 4.

FIG. 15B shows a top section view of the eye contact communicationssystem illustrated in FIG. 13B and FIG. 14B. The image display device 4is directly behind the black panel 8. The camera 1 views forward to themirror 42. The beamsplitter 2 may be wider at the front than at theback.

FIG. 16B shows a user 3 viewing the eye contact communications system inFIG. 15B. The user 3 has a line of sight 271 at the left edge of theimage display device 4, which views to a wall 260. The wall 260 isilluminated by set of lights 261. The beamsplitter 2 is wider at thefront, which makes it possible for the line of sight 271 to be throughthe beamsplitter 2 from the bottom to the top as the user views theimage display device 4. If the beamsplitter 2 would be only the width ofthe black panel 8, the line of sight 272 at the top of the beamsplitter2 would expose a direct view of the image display device 4. The width ofthe top of the beamsplitter 2 can be specified to be wide enough tocover the desired direction 271 of the angle of viewing from the side.However, it is important to note that the viewing of the image displaydevice 4 in a direction 272 that directly exposes the image on the imagedisplay device 4 is not a serious problem in terms of the visual effect.

FIG. 17 illustrates a perspective view of the embodiment illustrated inFIGS. 13A, 14A, 15A, and 16A. The observer 3 views through the two-waymirror 2 to see the superimposed images on three planes, including afirst plane with the image of a transmitted person 7 as displayed in theimage display area 17. The second plane is comprised of the superimposedand matched locations of the back edge 35 of the enclosure of the imagedisplay device 58 and the reflected view of the top edge 34 of the sidesof the backdrop 31. A third plane is furthest back comprised of thereflected view 37 of the backdrop 36. This perspective view illustratesthe potential to see through the two-way mirror 2 to a background 74that is to the left of the back edge 35 of the image display enclosure.In addition to the depth cues in the three planes showing thetransmitted image of a person 7 and the backdrop panels 31 and 36, theobserver 3 can see the depth relationship to the three-dimensionalsetting of the room. In particular, objects such as a lamp 73 can be adepth cue and contribute to the illusion that the transmitted person 7is within the context of the three-dimensional room setting. All of theaforementioned visual effects contribute to a perception that thetransmitted person 7 is actually in the room and engaging withface-to-face communication with eye contact with the observer 3.

FIG. 18 through FIG. 25 illustrate a method of collapsing the embodimentof FIGS. 13A, 14A, 15A, and 16A into a compact structure. FIG. 18illustrates a front view of the embodiment with the side panels of thebackdrop 31 and the light structures 32 folded inward. FIG. 19 is a sideview of the same embodiment with the side panels 31 folded inward. FIG.20 shows the backdrop comprising the back panel 36 and the sides 31folded back at pivot point 72. A pair of hinges may be used at position72 to rotate down the backdrop assembly. The camera 1 and codec 40 areattached to shelf 41 to hold them in position.

FIG. 21 shows the overhead black panel 16 and the attached overheadextension panel 62 rotated downward. FIG. 22 illustrates the two-waymirror 2 with the overhead panel 16 and overhead extension panel 62 inthe process of being rotated downward at pivot point 51. A pair ofhinges may be used at pivot point 51 for rotating the two-way mirrorassembly. The supporting rod 49 may be attached to a fixed position onthe frame of the two-way mirror 2 with a rotating mechanism 75. Therotating mechanism 75 may be ball joint to allow for a complex angularmovement of the angled edge of the two-way mirror 2 as it is lowered.The lower edge of the structural rod 49 may comprise a slider mechanism76 that glides on the diagonal structural member 56.

FIG. 23 illustrates the two-way mirror 2 lowered to a position parallelwith the diagonal structural member 49 with the overhead panel 16 andoverhead extension panel 62 on top. FIG. 24 shows the overhead extensionpanel 62 rotated upward to cover the two-way mirror 2. In this closedposition, the image display area 17 in the image display enclosure 58 isin clear view for the display of normal video or computer displaymaterial. In this closed position, the total system may be narrow enoughto roll through a standard single door with the communications system oncasters 50.

FIG. 25 shows the enclosure 58 for the image display device rotateddownward at pivot point 77. In this arrangement, the system is compactfor placement in a shipping container for shipping. The embodiments inFIG. 18 through 25 may similarly be applied to the embodiments in FIGS.13B, 14B, 15B, and 16B.

FIG. 26 shows an observer 3 seated at a table 33 with an angle of view43 looking forward to see an image 17 displayed on an image displaydevice 4 on a first plane with a reflected backdrop 21 superimposedbehind on a second plane. Along this same angle of view 43 the observer3 sees a view 44 of a reflection of a backdrop 30, which is locatedbelow the two-way mirror 2. The reflection appears on a second planethat is in a location 21 behind the first plane of the image on theimage display device 17. A camera 1 is placed on a shelf 41 that isincorporated into the backdrop 30. The camera 1 could be attached to acodec 40. A mirror 42 is positioned in the path of the view of thecamera 1. The two-way mirror could be angled at 45 degrees so that ahorizontal backdrop would appear to be vertical in the reflection.However, in this illustration, the two-way mirror 2 is angled at 50degrees with the backdrop at 10 degrees from horizontal. Othervariations in angles could be implemented to achieve an end result of areflection of a vertical superimposed backdrop at the second plane 21.

FIG. 27 shows the angle of the view 45 of the camera 1 as it isreflected off the mirror 42 directly in front of the camera 1. For thebest quality of image the mirror 42 may be a front surface mirror toeliminate any unwanted secondary reflection that could be a problem witha normal glass mirror. The mirror 42 is angled so that the camera willsee the angle of view 46 of the observation zone as a reflection off thetwo-way mirror 2. Since the mirror 42 is added in front of the camera 1,it is possible for the camera to be placed in a horizontal position on ashelf 41. This has the advantage that it is easier to place a camera 1on a horizontal shelf 41 than securing it to a supporting structure tohold it in a vertical orientation. Another advantage of the mirror 42 isthat it eliminates the problem of capturing a reversed image as wouldresult from a single reflection off the two-way mirror 2. The doublereflection results in an image captured by the camera 1 that is notinverted or flipped. This illustration shows that the direction 47 ofcamera 1 views a line of sight 48 that aligns with the eyes of atransmitted person appearing on the image display area 17. It is notnecessary for the observer 3 and the transmitted person to be at thesame height since eye contact can be achieved with the correct positionof the camera at the eye level of the displayed person.

FIG. 28 shows the path of the view of the camera 45 as it views throughthe two-way mirror 2 to the black panel 16 positioned above the two-waymirror 2. In this way, extraneous light and non-essential images (e.g.,the ceiling) that would detract from observation of the desired imageare minimized.

FIG. 29 shows an embodiment of the invention in an enclosure 54 with anobserver 3 seated at a table 33. The image display area 17 on a firstplane displays a portion of a life size image of a person from a remotelocation. The camera 1 is positioned in a backdrop 30 below the two-waymirror 2. The camera 1 is positioned to be horizontal so that it viewsthe reflection off a mirror 42. A black overhead panel 16 is above thetwo-way mirror 2. The reflected image of the backdrop 30 is viewed on asecond plane as a superimposed image 21 behind the first plane of theremote person displayed on the image display area 17.

FIG. 30 shows a portion of the backdrop 30 rotated on a pivot point 52so that it can be folded back when the system is not in use. The mirror42 for the camera 1 rotates back with the portion of the backdrop.

FIG. 31 shows the two-way mirror 2 rotated on a pivot point 51 to folddown to the lower position.

FIG. 32 shows the black overhead panel 16 folded back along a pivotpoint 53.

FIG. 33 shows the system in a closed position to contain the specialistdisplay technology within the enclosure 54. The observer 3 can view theimage display area 17 directly for normal viewing of video or computerimages. The system is on casters 50 so that it can be rolled to anotherlocation. The system could be narrow enough to fit through an openingfor a single door.

FIG. 34A shows a configuration that provides a combination of a desk anda display system within a single enclosure 60. The two-way mirror 2reflects a backdrop 30 that is integrated into the desk. The camera 1 ispositioned horizontally with a mirror 42 in front of it so that the lineof eye contact 48 is reflected 47 to the camera 1. A black panel 16 ispositioned above the two-way mirror 2. The reflection of the backdrop 31appears to be on a second plane behind the image display area 17 on afirst plane.

FIG. 34B shows a complete eye contact communications system within astructure 60 that may be on casters 50. The user views forward at eyelevel to the image display device 4 along a line of sight 48, which isreflected in the beamsplitter 2 along the direction 47 to a mirror 42that is reflected to the camera 1 along the direction 238. Alight-absorbing surface 16 is positioned above the beamsplitter 2 and apanel 8, which is a black panel, is positioned below the beamsplitter 2.The user 3 can touch a computer interface 273, such as a keyboard ortouch panel, on a shelf 274. The shelf 274 may be on slides to retractinto the structure 60. When the shelf 274 is retracted the eye contactcommunications system structure 60 may be narrow enough to pass througha standard single doorway.

FIG. 34C is similar to FIG. 34B, except that the beamsplitter 2 isangled upwards. The light-absorbing surface 16 is below the beamsplitter2 and the black panel 8 is above the beamsplitter 2. The user viewsforward at eye level to the image display device 4 along the direction48, which is reflected in the beamsplitter 2 along the direction 47 to amirror 42 that is reflected to the camera 1 along the direction 238.

FIG. 35 shows the two-way mirror 2 folded down on a pivot point 51 tolay horizontal on the top of the backdrop 30.

FIG. 36 shows the black overhead panel 16 folded down to lay horizontalon top of the two-way mirror 2.

FIG. 37 shows an additional section of panel 62 that is flipped over tocover the remainder of the horizontal surface. The exposed top of theblack panels 16 and 62 could be comprised of a material that is wellsuited to form the top of the desk. In this closed position, theobserver 3 could directly view the image display area 17.

FIG. 38A shows an embodiment that can be placed on a table or desk 33.The system has a two-way mirror 2 that is angled to reflect a backdrop30. A camera 1 is positioned in the backdrop 30. The camera 1 ishorizontal with a mirror 42 in front that is angled upward along a lineof sight 47 toward the two-way mirror 2 so that it matches the line ofsight 48 for eye contact with the observer 3. A black overhead panel 16is in the camera view as seen through the two-way mirror 2. Thereflected backdrop 23 on a second plane appears to be behind the imagedisplay area 17 on a first plane.

FIG. 38B shows a similar structure 61 without much light beingsuperimposed. The user 3 views forward at eye level to the image displaydevice 4 along a line of sight 48, which is reflected in thebeamsplitter 2 along the direction 47 to a mirror 42 that is reflectedto the camera 1 along the direction 238. A light-absorbing surface 16 ispositioned above the beamsplitter 2 and a black panel 8 is positionedbelow the beamsplitter 2.

FIG. 39 shows the two-way mirror 2 and the overhead light-absorbingsurface 16 rotated downward for the two-way mirror 2 to be parallel withthe panel 8. FIG. 40 shows the two-way mirror 2 and black panel 16rotated downward to be parallel with the two-way mirror 2. In thisconfiguration the image display device 4 may be observed directly toview video or computer images on the image display area 17.

FIG. 41 shows an embodiment of the invention that is at a height that issomewhat higher than eye level for a seated person so that the displaycan be viewed by either a seated observer 3 or a standing observer 70.In this embodiment, the image display device 78 is a rear projectionvideo display system that is supported on a base unit 71. The two-waymirror 2 is connected to a base unit with a hinge or other pivotingdevice 51. A backdrop 30 is connected to the base unit 71 with apivoting device 55. A camera 1 is in a horizontal orientation and isplaced on a shelf 41 that is incorporated into the backdrop 30. A mirror42 in front of the camera is at an angle so that the camera views thereflection of the observation zone with the observer 3. An overheadblack panel 16 is positioned above the two-way mirror 2 to block anylight from exposing the view of the camera 1 through the two-way mirror.

FIG. 42 shows the backdrop 30 rotated at a pivot point 55 to a positionwithin the base unit 71.

FIG. 43 shows the two-way mirror 2 rotated down at a pivot point 51 to avertical position with the overhead black panel 16 attached. FIG. 44shows the overhead black panel 16 rotated along the front edge of thetwo-way mirror 53 to a vertical position in front of the two-way mirror2. The exposed surface of the black overhead panel 16 could be comprisedof a material that provides protection of the two-way mirror 2 and isaesthetically pleasing for the exposed front of the system. In thisclosed position, the image display area 17 is in clear view of theobservers 3 and 70 so that it can be used for the display of normalvideo and computer graphics using the image display device 78. Thesystem is on casters 50 so that the system could be rolled into a roomfor usage. The system could be narrow enough to roll through an openingfor a single door.

FIG. 45 shows an embodiment of the invention that matches the line ofsight 48 of a seated observer 3 with the height of the eye level of aperson displayed on the image display area 17. Since the display is ateye level for a seated person, it is necessary for the two-way mirror 2to be longer than the configuration illustrated in FIG. 41 through 44 sothat a standing person 70 can view the image display area 17. The baseunit 71 could have a mechanical device 82 that could raise and lower thecommunication system. In this way, the image of the transmitted personcould be raised for horizontal eye contact with a standing observer 70or lowered for horizontal eye contact with a seated observer 3.

In this configuration, the black overhead panel 16 preferably does notextend to the top of the image display enclosure 58. The smaller sizeoverhead panel 16 is adequate to block light within the angle of view 45of the camera 1. The black overhead panel 16 could be angled so that itdoes not block the view from the position of the observer 3. Theobserver could see a view 80 through to the space between the imagedisplay enclosure 58 and the black overhead panel 16 so that the imageof the displayed remote person does not appear to be confined by theblack overhead panel 16. This would increase the perception of a senseof presence of the remote person within the three-dimensional setting ofthe room.

FIG. 46 shows the black overhead panel 16 rotated down as an initialstep of closing the system for storage or moving. The two-way mirror 2is held by a structure 72, which extends beyond the pivot point 51. FIG.47 shows the two-way mirror 2 rotated upward at the pivot point 51 to avertical position. The structure 72 holding the two-way mirror 2 extendsbelow the position of rotation 51. A mechanical device 81 (e.g., apneumatic cylinder or spring-loaded device) could be attached to thestructure 72 at the end of the extension below the position of rotation51, to assist in raising the two-way mirror 2. FIG. 48 shows the pair ofprotrusions 32, preferably including illumination sources, raised to avertical position. FIG. 49 shows the backdrop 30 raised to a verticalposition from pivot point 55. In this closed arrangement thecommunication system could be narrow enough to fit through a standardsingle door opening. The communication system is preferably on casters50 to make it easy to move.

FIG. 50A shows an embodiment of the invention integrated into a retaildisplay or information kiosk. The two-way mirror 2 is angled to reflecta backdrop 95 above. The camera 1 is positioned along the line of sightof the image of a person displayed on the image display area 17. Thebackdrop 95 is reflected to appear as a superimposed image 96 behind theimage display area 17. A keyboard 94 could be used to input information.Shelves 91 could be used for products. A dispensing device 97 could beused to dispense products. A payment device 90 could accept cash orcredit card payments. A storage area 93 could be used to provideproducts for the dispensing device 97.

FIG. 50B shows an eye contact communications structure 275 that mayminimize superimposing images and that could be used as a retaildisplay, information kiosk, vending machine or similar free standingstructure. The user 3 looks forward along a line of sight 48 to make aperceived eye contact with a remote participant appearing on the imagedisplay device 4. The beamsplitter 2 reflects along the line of sight 47to the camera which is integrated into a black panel 8. Below thebeamsplitter is a light-absorbing surface 16. A computer interface 273is available for interaction with the communications system. The systemmay incorporate a codec 40 for coding the outgoing video and audiotransmission and decoding of the incoming signals. A dispensing machine276 may be included and this may have a storage compartment 277 forholding the money or products to be dispensed. The system may includeshelves 278 for products.

FIG. 50C shows an eye contact communications module 279 that may be afully self contained module to fit into a wall 280. This same module 279could be placed on a supporting base, hung from a ceiling, attached to awall, placed on a cart or integrated into another structure. The module279 could be used as an ATM machine for a customer to communicate with abank representative with eye contact. The module 279 could be used as asales kiosk within a store or in a public place for communication withsales representatives with eye contact. The system could be aninformation point for government, police, community services, socialservices, travel services, tourism information and other services thatwould benefit from live communication with eye contact. The user 3 looksforward along a line of sight 48 to make a perceived eye contact with aperson appearing on the image display device 4. The beamsplitter 2reflects along the line of sight 47 to the camera which is integratedinto a black panel 8. Below the beamsplitter is a light-absorbingsurface 16. An interactive panel 281 is available for interaction withthe communications system. A dispensing machine 276 is available fordispensing cash, gift cards, receipts, information pamphlets, governmentforms, food vouchers, travel tickets, show and entertainment tickets,and other material that supports the communication with the user 3. Themodule 279 may have a computer 282 and a codec 40.

FIG. 50D shows an eye contact communications system structure 283. Thestructure 283 could be a free standing kiosk that could be placed in anairport, shopping mall, store, community center, government facility, orother place accessed by potential users. The structure 283 could bedesigned to be placed within a climate controlled environment or couldbe designed to be placed outdoors. The user 3 looks forward along a lineof sight 48 to make a perceived eye contact with a person appearing onthe image display device 4. The beamsplitter 2 reflects along the lineof sight 47 to the camera which is integrated into a black panel 8. Theblack panel 8 is positioned a distance above the top of the beamsplitter2. This position of the black panel 8 allows for a taller person to seeinto the system to the image display device 4. Below the beamsplitter isa light-absorbing surface 16. An interactive panel 281 is available forinteraction with the communications system. The system may also have acomputer interface 273.

FIG. 50E is a front view of the kiosk structure 283. At the front of thesystem may be an interactive panel 281 and a computer interface 273. Inthis embodiment, the black panel 8 is extended upwards to allow forclear viewing into the area of the image display device 4. However, theparameter of the width of the image display device 4 and the overheadblack panel 8 may be the same width. The image display device left edge259 is aligned with the black panel left edge 255, and the image displaydevice right edge 258 is aligned with the black panel right edge 254.

FIG. 51 shows a large embodiment. A standing observer 70 could view alife-size person appearing on a front projection screen 104. A projector100 could be positioned above the two-way mirror 2 to project at anacute angle 101 toward the screen 104. A backdrop 105 could bepositioned below the two-way mirror 2. The backdrop 105 would reflect inthe two-way mirror 2 to appear to be a superimposed backdrop 106 on asecond plane behind the image plane of the screen 104 on a first plane.A camera 1 could be incorporated into the backdrop 105. A black panel 16could be positioned above the two-way mirror 2. A black light baffle 103could be positioned between the camera 1 and the projector 100 so thatthe projector is not within the view of the camera 1.

FIG. 52 shows the configuration illustrated in FIG. 51 with the two-waymirror 2 rotated 90 degrees at a pivot point 107. A projector 109 ispositioned below a table height panel 110. Further details regardingthis configuration are provided with respect to FIG. 53.

FIG. 53 shows a presenter 111 standing in a position within the view 108of a camera 1. The camera 1 is located below the two-way mirror 2 with asmall aperture 115 to view through a front projection screen 113. Ablack panel 16 is above the two-way mirror so that the camera viewthrough the two-way mirror 2 does not add light to the camera image. Thefront projection screen 113 could be rolled out from a tube 116 to coverthe backdrop 105. The camera 1 is positioned to be at eye level for thepresenter 111 so that the presenter is captured at the correct angle fordisplay at a distant location at a system as illustrated in FIG. 51. Thepresenter sees the reflection 114 of the image projected on the screen113 by the projector 109 below the table height panel 110.

This configuration could allow a teacher to present to both a class inthe same room and, simultaneously, present to a class in a distantlocation using a system as shown in FIG. 51. The teacher 111 would beable to make eye contact with a person 70 in the room when the room isilluminated bright enough for the teacher to clearly see the student inthe room. The lighting in the class room could be dimmed so that theteacher could clearly see the reflected image 114 of the remoteclassroom. The teacher could easily switch between discussions with theclass present in the room or two-way interaction with the class in thedistant location. The teacher would be directing his or her attention inthe same direction for both locations so that all students would appearto be having the presentation directed toward them. The image of theteacher could be transmitted to an unlimited number of locationssimultaneously. Any interaction with a selected location would appeardirectly in front of the teacher for natural interaction.

A flat panel monitor 112 could be positioned at a selected height by thepresenter for making notations that would be displayed for the class.Since the teacher would be facing in the direction of the classes, he orshe would not need to turn away from the class as would be done with aclassic blackboard.

FIG. 54 shows a front view of the configuration of the largetelepresence system illustrated in FIG. 51. The image area 117 is largeenough for the presenter to move freely. A screen 119 shows graphics,such as a PowerPoint show or live annotations by the presenter. Theimage of the transmitted presenter 118 appears life-size above the levelof a table 110. A projector 100 projects the image of the presenter 118.A second projector 102 projects the image of the graphic visual support119. A backdrop 105 is reflected to appear behind the presenter 118 andthe presentation screen 119.

FIG. 55 shows the front view of FIG. 53 with a portion of the image area119 dedicated to a presentation, such as a PowerPoint show. This imagecould be projected by a second projector 102 so that the graphic image119 would have the necessary brightness and high resolution. The imageof the teacher needs to be in real time for interaction without anydelay. In order to avoid excessive requirements for bandwidth, this realtime image is compressed. However, a graphic display 119 does not havethe same requirement for quick refreshing of the image. Therefore a highresolution image can be transmitted with a small bandwidth with a slowerrefresh rate. It may be more practical to have one transmission for thelive presentation of the teacher and a second transmission for thegraphic support. Furthermore, the graphic display could be contained ona computer at the location of the class with a data sharing software toallow the presenter 111 to send commands to trigger the advancing of theimages.

A flat panel monitor 112 could be positioned at a comfortable height forthe presenter 111 for making notations while standing in front of theclass. The notations made by the presenter could appear on the screen119 to the side. The presenter 111 can stand to the side or can walkinto the area of the image of the projected image to provideannotations.

FIG. 56A shows a side section view of an embodiment of the inventionthat incorporates a second image display device 69, which could be anLCD monitor, plasma monitor or other type of image display device. Thesecond image display device 69 is held in position with a mountingbracket 79. The second image display device 69 could be used forsupporting visuals, such as PowerPoint presentations, computer graphics,financial data, drawings, illustrations and various other visuals. Thisconfiguration is designed so that the second image display device 69 andthe mounting bracket 79 could be removed for usage of the communicationssystem without the display of supporting visuals.

A camera 1 is positioned on top of a codec 40, which is used for codingand decoding video and audio transmission for the two-waycommunications. The codec 40 is placed on a horizontal shelf 41. Thecamera 1 is in a horizontal orientation viewing forward to a reflectionoff a mirror 42. The angle of view 45 off the mirror 42 is in an upwarddirection toward the two-way mirror 2. The view through the two-waymirror 2 is of the black out panel 16, which does not add any light tothe camera image since it is substantially black. The reflection off thetwo-way mirror 2 is in a forward angle of view 46, which encompasses theobservation zone including observers 3 and 70.

The two-way mirror 2 is held in position by a bracket 125 at the bottomedge and a bracket 126 at the top edge. The overhead panel 16 preferablyacts as a structural tension member to hold the two-way mirror 2 at thedesired angle. A set of hinges 127 holds the overhead panel 16 securelyto the structure of the image display device enclosure 58. When thetwo-way mirror 2 is installed the overhead panel 16 could be rotatedupward toward a vertical position while positioning the two-way mirror 2on the supporting bracket 125. The hinges 127 preferably have a constanttorque tension so that the overhead panel 16 would remain in an upwardposition while the two-way mirror 2 would be installed. Once the two-waymirror 2 is positioned on the lower supporting bracket 125 the overheadpanel 16 could be lowered to allow a bracket 126 to overlap the top edgeof the two-way mirror 2.

The observers 3 and 70 view through the two-way mirror 2 to see theimage of a transmitted person appearing on the image display device 17.The two-way mirror 2 reflects a backdrop comprised of a back panel 36and an angled front panel 87, which are viewed by the observer as thereflected back panel 37 and the reflected front angled panel 88. The topedges of the left and right side panels 34 are aligned to match the leftand right back edges 35 of the image display enclosure 58.

The observers 3 and 70 will see the superimposed image of a transmittedperson appearing on the screen of the image display device 17, whichwill be defined as a first plane being the closest to the observers. Asecond plane will be defined to be the location behind the first planewhere the left and right back edges 35 of the image display deviceenclosure 58 match to the reflected image of the top edges 34 of theside panels of the backdrop. The third plane is defined as the moredistant location behind the second plane where the back panel of thebackdrop 36 is viewed as a reflection in the location of the dashed line37. The top panel 87 of the backdrop extends from the second plane backto the third plane in the location of the dashed line 88.

A speaker 83 is located below the codec 40. The system is on casters 50so that it can be easily moved within the room or between differentlocations. The seated observer 3 can input commands through a keyboard121, which is connected to a computer 120 by way of a cable 122. Thecomputer 120 is connected to the second image display device 69 by wayof a cable 123. One skilled in the art will recognize that in otherembodiments, the computer could be integrated within the housing of thetelepresence display system.

FIG. 57A shows a front section view of the embodiment shown in FIG. 56A.A camera 1 is positioned above a codec 40, which is on a shelf 41. Aspeaker 83 is located below the shelf 41. Lights 85 are located in theenclosure behind the backdrop sides 31. The backdrop sides 31 arebacklit display panels, which could be comprised of a white plasticlight diffusion surface covered with a color transparency of a graphicor photographic image. The image on the color transparency could be of acomposition that is optimal as the reflected backdrop sides 124 for thesuperimposed images of the transmitted person or people on the imagedisplay screen 17. The image on the transparency of the backdrop side 31could incorporate a perspective view to accentuate depth or a texture toprovide a depth cues. In particular, the transparency image could be ofthe optimal brightness to be bright enough to clearly view the reflectedbackdrop sides 124 in its relationship to the first plane of the imagedisplay device screen 17 incorporating the image of the transmittedperson or people, however, not so bright that the superimposed image ofthe side backdrop panels 124 burn through the image of the first plane17.

The back panel of the backdrop 36 incorporates an opening 29 for theview of the camera 1. The back panel of the backdrop 36 could be blackso that it does not accentuate the opening 29, which is preferably darkor black in the area of the camera 1. When the back panel of thebackdrop 36 is viewed as a reflection in the two-way mirror 2, itappears as a vertical panel 37 in the middle of the image area of thedisplay screen 17. It is ideal for the reflected back backdrop panel 37to be dark or black so that it does not superimpose any light onto theface or body of the transmitted person appearing in the middle of thescreen 17. Likewise, it is preferable for the reflected front backdroppanel 88 to be dark so that it also does not superimpose light onto theface of the person appearing on the screen of the image display device17. It is important to note that the sense of depth in the embodiment ofthis invention is achieved by the viewing of the telepresent person onthe first plane relative to the backdrop appearing in the locations ofthe second and third plane that are further away. However, it is notnecessary that the backdrop covers the full area of the first plane ofthe image display screen 17. In fact, it could appear more effective tosee the telepresent person appearing to be extending out beyond theconfines of the backdrop. This visual effect is achieved in thisconfiguration in that the reflected side panels 124 do not cover thefull area behind the image display screen 17. As a result, the head andextended arms of a telepresent person appearing on the image displayscreen 17 will extend above the reflected side panels 124 to accentuatethe depth relationship.

FIG. 58A shows a front elevation of the embodiment illustrated in FIG.56A. The second display device 69 is in clear view in front of the imagedisplay device 17, which shows the telepresent person. The sound for thecommunications system emanates from the speaker aperture 84, which couldbe covered with a speaker grill. The two-way mirror 2 extends beyond thewidth of the image display device enclosure 58. The black overhead panel16 is not obtrusive since it matches to the height of the two-way-mirror2 and the image display enclosure 58.

FIG. 56B shows an eye contact communications system in a structure 290that comprises a fully self contained telepresence system that minimizessuper-imposed images. The user 3 looks forward along a line of sight 48to make a perceived eye contact with a remote participant appearing onthe image display device 4. The beamsplitter 2 reflects along the lineof sight 47 to a mirror 42 that reflects in the direction 238 to thecamera 1. In this configuration the beamsplitter 2 is angled up morethan 45 degrees from a horizontal plane. In this illustration the angleof the beamsplitter is 49 degrees from a horizontal plane. The angle ofthe mirror is also 49 degrees from a horizontal plane. In order for thereflection of the black panel 8 to be parallel to the vertical plane ofthe face of the image display device 4, the black panel 8 is angledupwards from a horizontal plane. In this illustration the angle of theblack panel 8 is 8 degrees from a horizontal plane. The user 3 can viewalong the direction 229 to the bottom of the image display device 4.Since the angle of the black panel 8 is close to the bottom of the viewdirection 229, the user can clearly see the image display device 4 whilenot viewing much of the black panel 8. Another advantage of thisarrangement is that it is possible to place a data monitor 69 in clearview for the user with the top edge of the data monitor 69 just belowthe extension of the black panel 8. The system may incorporate acomputer 282 for the data monitor 69. The user 3 may sit at a table 33with computer interface 273. The structure 290 may incorporate casters50.

FIG. 57B is a front section view of FIG. 56B. The beamsplitter 2 is acustom shape that allows for the front portion to be wider for viewingof the image display device 4 from a position of axis from the center.The camera 1 is positioned below the image display device 4. Thestructure 290 is tapered inward on the sides to minimize the bulk of thesystem. This section view shows the black panel 8 at the location of theposition closest to the beamsplitter 2. The black panel left edge 255 isaligned to the image display device left edge 259 and the black panelright edge 254 is aligned to the image display device right edge 258.

FIG. 58B is a front elevation view of FIGS. 56B and 57B. This frontelevation view shows the front edge of the black panel 8, which ishigher than the back edge. The black panel left edge 255 is aligned tothe image display device left edge 259 and the black panel right edge254 is aligned to the image display device right edge 258. The datamonitor 69 is just under the front edge of the black panel 8. The bottomof the image display device 4 appears to be cut off in this elevationview. However, the image display device 4 will be within view from theheight of eye level for a seated user.

FIG. 59 shows a section in plan view of the embodiment illustrated inFIG. 56A. The camera 1 and codec 40 are below the back panel of thebackdrop 36. An aperture 29 is the opening in the back of the backdrop36. The front panel 87 extends to the back panel 36. The side panels 31extend from the back panel 36 to the left and right edges 34. The widthof the backdrop matches the width of the image display device enclosure58 so that the left and right edges of the backdrop 34 match to the leftand right edges of the enclosure 35. The image display device 57 showsan image on the first plane 17. A depth relationship is achieved by thephysical depth relationship between a telepresent person appearing onthe image display screen 17 at the first plane and the front edges ofthe reflected side backdrop panels 124 matching to the left and rightedges 35 of the image display enclosure in the second plane. Thereflected backdrop sides 124 extend from the edges of enclosure edges 35in the second plane to the third plane of the reflected view of thereflected back backdrop panel 37.

FIG. 60 shows a plan view of the embodiment illustrated in FIG. 56A withthe black overhead panel 16 above the two-way mirror 2. The structure ofthe image display device enclosure 58 provides the support for holdingthe overhead panel 16 with the two-way mirror 2 supported at the frontedge.

FIG. 61A shows a perspective view of the embodiment illustrated in FIG.56A with a telepresent person 7 appearing in front of the backdropcomprised of the reflected back panel 37, reflected sides panels 124 andreflected front panel 88. The depth relationship of the backdrop sides124 to the background objects 89 is seen at the edge of the imagedisplay enclosure 35 as viewed through the two-way mirror 2. The secondimage display device 69 is in clear view of the observer 3 who is seatedat a table 33.

FIG. 61B is a perspective view of the embodiment of FIG. 56B. The user 3views an image of a life-size participant from a remote locationdisplayed on an image display device 4. The beamsplitter 2 extends onthe left side beyond the image display device left side 259 to allow aview through the beamsplitter 2 to see a plant 89 as part of the roomsetting. On the image display device right side 258 the user views thewall behind through the beamsplitter 2. With lights illuminating behindthe image display device 4 the room setting and the wall will beilluminated, which will minimize the superimposed appearance of thereflection of the floor in the beamsplitter 2.

FIG. 62 shows a side view of the embodiment of the invention illustratedin FIG. 56A and FIG. 56B without the second image display device. Thecommunications system could be narrow enough to fit through a standardsingle door opening without requiring that the two-way-mirror 2, theoverhead panel 16, or the image display enclosure 58 are removed. Thecommunications system could be on casters 50 so that it would be easy tomove the system between locations.

FIG. 63 shows another embodiment, which is configured for thetransmission of a presenter 128 to a location with a system in anembodiment as previously described. In this embodiment the presenter 128is positioned in front of a black surface 127 so that the captured imageof the presenter 128 will be surrounded by black. When this image of thepresenter 128 is displayed on a system with a reflected backdrop, theimage of the presenter will appear as a bright and clear image while therest of the surrounding black image area is not visible so that anillusion is created that the presenter is in the free space in front ofthe backdrop.

An advantageous application of this embodiment is for capturing theimage of a presenter 128 to be transmitted to a location of an audience,classroom or group meeting. For this application, it is not necessaryfor the presenter to see the group at the remote location appearing in adepth relationship to a superimposed backdrop on a different imageplane. The incoming image from a remote location of a group of people ina large room will not have the people appearing against a blackbackground. When people are not appearing on a black background, asuperimposed image of a backdrop would generate a conflicting image.Therefore, for this application, it is preferable to have a cleardisplay of the incoming image without any superimposed backdrop. Forthese reasons, the two-way mirror 2 would reflect a backdrop 99, whichcould be black. The backdrop 99 is preferably the same width as thewidth of the image display device 57. Therefore, the presenter 128 willsee a clear view of the image on the image display device 57 with nodistracting reflection. To the outside of the left and right edges ofthe image display device 57 the presenter will see the background of theroom setting.

The camera 1 could be positioned on top of a codec 152. The camera facesforward to view the reflection off a mirror 42 which in turn views theimage reflected off the two-way mirror 2 to capture an image of theobservation zone, including a presenter 128. The two-way mirror 2 issupported on a supporting bracket 125 and is held in position by theoverhead panel 16, which has a bracket 126 overlapping the top edge ofthe two-way mirror 2. An image display device 57 could be supported by astructure 102.

A second image display device 153 could be held in position by amounting bracket 79. The second image display device 153 could overlapthe edge of the table 98 so that it is not so high that it would blockthe view of the image on the image display device 57. The presenter 128is seated at a small table 33, which is positioned far enough away fromthe system located on the other table 98 so that the second imagedisplay device 153 could be within the gap between the tables and bewithin a clear view of the presenter 128. It could be helpful for theheight of the table 33 to be adjustable so that the table does not blockthe view of the torso of the presenter 128.

The presenter 128 could use a computer interface device 121, such as akeyboard and mouse or a graphics tablet with a stylus that is connectedby a cable 122 to a computer 120. The computer 154 could be connected tothe second image display device 153 by a cable 123.

The quality of the image of the presenter 128 could be optimized for thebest level of brightness, color temperature and balance by havingstrategically placed lights 129 and 131. The overhead light 129 could bepositioned above the presenter 128 to illuminate a highlight on the topof the head and the shoulders. This highlight can be very effective inproviding a clear edge to the head and shoulders of the presenter tostand out from the black background. This is especially important forcapturing the image of a presenter with black or dark hair or for apresenter wearing a dark coat or shirt.

The overhead light 129 could have baffles or a method of focus torestrict the light to an angle of coverage 130 that illuminates thepresenter 128 without illuminating the black background 127 or allowinglight to shine onto the communications system. The front light 131 couldhave baffles or a method of focus to restrict the light to an angle ofcoverage 132 that would fall on the presenter without shining onto thesecond image display device 153 or other components of thecommunications system.

The backdrop may be monochromatic to minimize the detail in the image.This monochromatic backdrop will require less bandwidth to transmitcompared to a backdrop with a significant amount of variation in colorand value. This is because the codec compresses the data for the imageand a single color of the same value requires less data. The color couldbe selected to be compatible with the images of people. A pure bluebackdrop may provide a “look” that is “corporate”. Other userapplications may prefer different color backgrounds.

In this configuration the beamsplitter 2 is angled back at 50 degreesfrom a horizontal plane and the black backdrop 99 is angled up at 10degrees from a horizontal plane. These angles may vary depending on thepositioning of the users so that the presenter 128 can view the fullimage display device 57 while not viewing down on the surface of theblack backdrop 99. The mirror 42 and placement of the camera 1 arepositioned to achieve the alignment of eye contact. The presenter 128may clearly view the data monitor 153.

FIG. 64 shows an eye contact configuration with the user 3 sitting closeto the configuration. The camera 1 views the user 3 with wide field ofview 45. The user 3 has a raised hand 156, which is in the view of thecamera 1. A mirror 42 is positioned between the two-way mirror 2 and thecamera 1 so that the image is not reversed and the camera is in ahorizontal orientation. The camera 1 is raised on a supporting structure155 and the eye contact arrangement is placed on a table 33.

FIG. 65 shows an eye contact configuration with a monitor 17 positionedbelow a two-way mirror 2, which reflects an image of what is displayedon monitor 17, the image appearing to user 3 to be a plane 5 behindtwo-way mirror 2. The eye contact terminal is raised up to anapproximate eye level with supporting structure 155, which is placed ona desktop 33. The camera 1 views the user 3 while a hand 156 is raisedinto the wide field of view 45.

FIG. 66 shows a user 3 with a hand 156 held within a wide field of viewgenerated from the camera of either the eye contact configuration ofFIG. 64 or the eye contact terminal of FIG. 65. Since the hand is closerto the camera than the body of the user, the hand is distorted to appearto be larger than the user's head. This distortion of the display of theuser can be disconcerting to the viewer receiving the telepresencecommunication. Furthermore, it is well known that portrait photographyor video production positions the person at a reasonable distance fromthe camera. A wide angle of view causes distortion to the face, such asexaggeration of the size of the nose of the person.

FIG. 67 shows an image of a user 3 as seen by a camera at a desirabledistance from the camera. This images shows that the outstretched hand156 is not excessively enlarged relative to the rest of the body.Furthermore, the features of the face are not distorted by thispreferable viewing distance. In this view the camera was approximatelyeight feet from the person.

FIG. 68 shows the eye contact terminal of FIG. 65 with a camera 1positioned at a desirable distance 11 from the user 3. This drawing wasproduced with a distance 157 of eight feet. This distance can besomewhat more or less with varying results. The resulting angle of view45 does not distort the image of the user 3 as shown in FIG. 67. Thisarrangement shows a long table 33 spanning the distance between the user3 and the camera 1 within the eye contact terminal. The total distance158 between the user 3 and the back of the eye contact terminalstructure 158 is excessively long. This configuration would be too largeand therefore not be practical for most applications. Furthermore, theuser 3 is so far from the eye contact terminal that the image 5 wouldappear too small to see clearly. As a result, this arrangement of an eyecontact terminal is unsatisfactory.

FIG. 69 shows an embodiment of the present invention with a user 3viewing an image display device 17 at eye level. A camera 1 captures theimage of the user 3 by way of a reflection off mirror 42 and two-waymirror 2. Without the two reflections the location of the camera wouldneed to be in position 200. The distance between the apparent positionof the camera 200 and the user 3 is indicated by distance 157, which inthis illustration is 8 feet. The actual distance could vary, but thisdistance of 8 feet achieves a desirable angle of view 45. In thisembodiment the distance between the user 3 and the back of the imagedisplay device 17 is a distance 159 of 4 feet, which is half of thedistance 157 of the camera view and less than half of the depth of theunsatisfactory eye contact configuration illustrated in FIG. 68.

FIG. 70 shows the line of sight at eye level between the user 3 and thecamera 1. In this configuration the segment 160 is approximately 30″.Segment 161 is approximately 48″ and segment 162 is approximately 18″.The total distance of all three segments is approximately 96″ or 8 feet.The physical horizontal distance 159 between user 3 and back of theimage display device 17 is about 4 feet. Also, it is this same physicalhorizontal distance 159 between the user 3 and the back of the camera 1.However, by using the two reflections—from two-way mirror 2 and smallmirror 42—an optical distance or line of sight distance twice as long(or longer) can be achieved within the same physical distance 159. Whilethe use of two reflections in the camera line of sight has been known,the appreciation for the placement and angle of the mirrors in order tocompensate for distortion has not been known. It is believed that thepresent inventor is the first to appreciate the unique and desirableconfiguration by which undesirable distortion can be reduced oreliminated by creating an asymmetrical configuration in which theoptical distance between user 3 and display 7 differs significantly fromthe optical distance between user 3 and camera 1—even when the physicaldistances are the same or similar.

The angle of the two-way mirror 2 could be between 45 degrees and 50degrees, but is not limited to this range of angles. The angle of thetwo-way mirror 2 in this illustration is 48 degrees. By angling thetwo-way mirror 2 at 48 degrees the image path 161 is angled away fromthe position of the camera 1, which results in the length of the imagepath 162 becoming longer. The back of the camera 1 can be alignedvertically with the back of the image display device 17 to achieve thelongest camera view while maintaining the most compact profile of thetelepresence workstation. In order to achieve a horizontal line betweenthe small mirror 42 and the camera 1, it should parallel the angle ofthe two-way mirror 2. In this illustration the small mirror 42 is at 48degrees from horizontal. One skilled in the art will recognize, however,that either or both mirrors could be tilted at other angles and theplacement of camera 1 adjusted accordingly.

FIG. 71 illustrates an optimal angle of view 45 for capturing an imageof the user 3 for display on a 50″ screen in a 16×9 aspect ratio, suchas a 50″ plasma display. The camera image will be transmitted to anothertelepresence system in a receiving location. At that receiving locationit is desired to display the image of the person at the telepresencesystem at life-size. Therefore, the camera 1 must capture the image ofthe user 3 at the correct size. In this illustration a line 201 providesa reference for the height of the image at the position of the user 3.For the purposes of this illustration the reference line 201 is a height163 of 20½″, which is the average height of a 50″ plasma monitortypically used in a telepresence system in a receiving location.

Also, FIG. 71 illustrates the location of a data sharing display monitor69 to be viewed by the user 3. This monitor 69 is positioned below thecamera view 45 that is reflected off the two-way mirror and in front ofthe camera view that is reflected off the small mirror 42. A keyboard 94is positioned on a telepresence workstation desktop 164. A panel 165 ispositioned at the back of the desktop 164. This panel 165 will protectmirror 42 and block any unwanted light from entering the view of thecamera 1.

FIG. 72 shows a panel 16 above the two-way mirror 2. The underside ofthis panel 16 is light absorbing, such as a matt black surface. Throughthe two-way mirror 2 is an extended camera view 168 that extends to theunderside of panel 16. Since this panel surface 16 does not reflect oremanate any light, the only light viewed by the camera is the reflectionoff the two-way mirror 2. It is important to note that the image displaydevice 17 should not be in the line of the extended camera view 168 andtherefore may need to be positioned a distance back from the two-waymirror 2.

FIG. 72 also shows a light absorbing panel 127 behind the user 3, whichcovers the full height of the angle of view 45 of the camera 1. Thisblack panel 127 is a particularly advantageous component when thetelepresence workstation is used for communication with a telepresencesystem capable of displaying a depth relationship between the image ofthe telepresent person and a physical background in the receivinglocation. Since the receiving image has a black background there willnot be any light displayed outside of the image of the telepresentperson. As a result, the person can be viewed in a three dimensionalrelationship in front of a reflected backdrop as shown in U.S. Pat. No.7,057,637 by White, incorporated herein by reference.

FIG. 73 shows a section view of the telepresence workstation withlighting. The overhead lighting 129 illuminates the top of the head andshoulders of the user 3. The angle of light coverage 130 should berestricted to only cover the area of the user 3. In particular, theoverhead lighting 129 should not shine on the black backdrop surface127. Also, the light should not shine on the monitor 69 or into the areaof the camera 1. Front lighting 131 is positioned to illuminate thefront of the user 3. This lighting 131 is particularly advantageous forilluminating the user 3 for a well lit camera view. The front lightingcould be positioned to the sides to minimize the light shining directlyinto the eyes of the user 3.

FIG. 74 shows a plan view of an embodiment of the invention. Thehorizontal angle of view 67 is the basis for the form and structure ofthe telepresence workstation. The angle of view 67 originates at a point200, which is determined by the desired optical distance to the camerawithin the path of a double mirrored rig, such as illustrated in FIG.71. The angle 67 is set by the width of the image plane 166 at themiddle of the location of the user 3. The width of the image plane 166is based on the width of the 16×9 aspect ratio of a 50″ plasma monitorin the present example. In order to capture a life-size image of theuser 3, the camera view must match the width of the display screen ofthe receiving telepresence system. Other configurations can bedetermined for other size and configurations of monitor through routineexperimentation.

Also in FIG. 74 the image display device 17 is specified to be a widththat will approximately fit within the angle 67. In this illustrationthe width of a 23″ LCD monitor in a 16×9 aspect ratio is used for thesize of the image display device 17. The two-way mirror 2 is atrapezoidal shape with sides that fit within the vertical planes of theangle 67. The two-way mirror 2 is preferably wider than the coverage ofthe angle 67 to allow for some extra margin in the camera coverage.

The telepresence workstation desktop 164 is preferably a trapezoidalshape to have the sides fit within the vertical plane of the angle 67.The sides of the desktop extend beyond the angle 67 to allow for anextra margin in the camera coverage. The black background panel 127 isset to be slightly wider that the width of the angle 67 as it reachesthe plane of the background 127. While the trapezoidal shape isparticularly advantageous for compactness, all manner of other shapesand configurations including square, rectangular, curved, and the like,are within the contemplated scope of the present invention.

FIG. 75 shows supporting structural panels 169 on the two sides of thetelepresence workstation. These side panels provide an enclosure on thesides to keep unwanted light from striking the camera inside of theworkstation. Also, the side panels support the two-way mirror 2. Thetelepresence workstation desktop 164 is attached to the side panels 169.A keyboard 94 may be placed on the desktop 164. A back panel 170 ispositioned behind the image display device 17. The back panel 170 isremovable to allow access for servicing the image display device 17.Also, a lower part of the back panel 170 is removable to provide accessto the camera, codec, computer and other equipment. The black backgroundsurface 127 is attached to a supporting structure 173. This supportingstructure 173 could be hung from the ceiling or supported from thefloor. In some configurations this supporting structure 173 may be inthe form of a sliding door or a hinged panel.

FIG. 76 shows a plan view of lighting in the telepresence workstation.One, two or more lights 129 may be positioned above the user 3. Thisoverhead lighting could be a strip of light, such as a fluorescentlight. The lighting 129 could be attached to the supporting structure173. These overhead lights 173 should cover the full width of the imagearea 166 to assure that the user 3 is illuminated from above. Thisoverhead lighting is especially important for a user 3 who has darkhair. The highlight can help the dark hair to stand out from the blackbackground as seen by the camera. The overhead lighting 129 is alsoimportant for providing a bright edge to the shoulders of a user,especially when the user is wearing a dark coat or shirt. The sidelights 171 could be position to shine across the width of theworkstation to illuminate the inside of the side panels 169. The sidelights 171 should be controlled to an angle 172 that does not allowlight to shine directly into the eyes of the user 3. Furthermore, theside lights 171 should be controlled so that light does not shinedirectly onto the two-way mirror 2 or the camera, which could introduceunwanted light into the camera view. Alternatively, the lights 171 couldbe integrated into the depth of the side panels 169 with a diffusionsurface to produce a large illuminated surface to illuminate the user 3with soft light.

FIG. 77 shows an arrangement of the overall workstations 174 as they arepositioned in a row. In this arrangement the back 170 of one workstationis aligned with the front of the desktop 164 of another workstation.With the adjacent workstations 174 flipped in vertical orientation theangled sides of the trapezoidal shapes align to produce a linear row.The backdrop structures 173 are in rows with a small gap between. Ifthis gap is not wide enough for a user to walk between, the backdropstructures 173 could be made to have the capability of sliding to theside or of rotating outward to allow access.

FIG. 78 shows another arrangement of the overall workstations 174. Inthis arrangement the back panel 170 is aligned with the backdropstructure 173. This produces an enclosed workspace. Access to theworkspace can be achieved by having the background panel 173 rotateoutward or sliding to the side.

FIG. 79 shows an arrangement of the trapezoidal workstations 174 withmatched sides to an adjacent workstation. The result is an arrangement,which could form a complete circle.

FIG. 80 shows an arrangement of the trapezoidal workstations 174 withmatched sides to form a curved arrangement.

FIG. 81 shows an embodiment of the invention in the configuration of areceiving communications system 133 connected by a network to a sendingcommunications system 134. It should be noted that telepresence is notpractical with standalone systems. Telepresence can be achieved when twoor more systems are connected over a network that meets specificrequirements. Therefore, it is advantageous for this invention toincorporate the specific technologies that are necessary to complete thetelepresence communications. For the purposes of discussion, thisembodiment of the invention is referred to as the “telepresencetechnologies configuration.”

In this telepresence technologies configuration, the sendingcommunications system 134 has a network connection 137 between thenetwork 144 and the codec 152. The receiving communications system 133has a network connection 136 between the codec 40 and the network 144.The network 144 could be an ISDN network, which could be provided by atelephone company. When transmitting on an ISDN network the codecs 40and 152 will preferably code and decode the transmission of audio andvideo in the H.320 protocol.

Alternatively, the network could be an IP network, such as the Internet,Internet2, LAN, WAN, MAN, VPN, ATM, or other network for transmittingdata in the Internet Protocol. When transmitting on an IP network thecodecs 40 and 152 will code and decode the transmission of the audio andvideo in the H.323 protocol or another IP protocol.

The computer 154 at the location of the sending communications system134 could be connected to the codec 152 with the cable 138 that wouldnormally be connected to the display monitor 153. A cable 139 would beconnected between the codec 152 and the display monitor 153 so that thesignal is passed through to the display monitor 153. The codec 152 willhave the capability of accepting the incoming signal for the displaymonitor through an internal hardware solution or an external datasolutions box. The codec 152 will process the signal for the displaymonitor and transmit it as part of the output through the networkconnection 137.

The codec 40 for the receiving communications system 133 will receivethe incoming signal over the network connection 136. The signal will bedecoded by the codec 40 and transmitted to the display monitor over thecable 135. In this manner, the output of the computer 154 at thelocation of the sending communications system 134 will appear both atthe display monitor 153 of the sending communications system and at thedisplay monitor 69 of the receiving communications system. The observers3 and 70 in the receiving location will see the output of the computer154 displayed in front of them on the image display device 69 as thisvisual content is controlled by the presenter 128 in the sendinglocation.

It is not necessary for the receiving location to have a computer sincethe incoming visual presentation is received over the network 140 anddecoded by the codec 40. However, in this configuration, the observers70 and 3 do not have a means for interacting with the visual displaycontent or an ability to transmit visual content back to the presenter128.

FIG. 82 shows a different telepresence technologies configuration with asending communications system 134 connected over an IP network 145 to areceiving communications system 133. The IP network could be any networkoperating in the Internet Protocol, such as a LAN, WAN, MAN, VPN,Internet2, the Internet or other IP network. In this configuration, thecodec 152 in the location of the sending communications system 134 isconnected by a network cable 148, such as a CAT5 cable, to an input box147 which is connected to an IP network 145 by a network connection 146,such as a T1 line, DSL, ADSL, VDSL, SDSL or other network deliveryservice. The codec 40 in the location of the receiving communicationssystem 133 is connected to the network 145 by a cable 141 to a junctionbox 143 and a network service 144. The codecs 40 and 152 can establishtwo-way communication over the network 145.

The computer 154 at the location of the sending communications system134 could have a network connection 149 to a junction box 147 for accessover a network service 146 to a network 145. The computer 120 in thelocation of the receiving communications system 133 could have a networkconnection 142 to a junction box 143 to a network service 144 to anetwork 145. The two computers 120 and 154 can establish a connectionover the network 145 and share data through a software application, suchas Microsoft NetMeeting or another data sharing software. Thisconfiguration has the advantage that both the send and receive locationscan interact with visual display material for effective collaboration.Also, this configuration has the advantage that the codecs 40 and 152 donot need to process any of the visual display material and, therefore,can dedicate their processing power and bandwidth to the quality of theaudio and video transmission.

FIG. 83 shows a telepresence technologies architecture that embodies acustom network architecture and innovative equipment functionality. Thistelepresence technologies architecture has both the locations 133 and134 connected to a telepresence operations center 150 that is specificto the requirements of achieving telepresence through the embodiment ofthe invention. Instead of a direct connection between the two locations133 and 134, each location would establish a connection to thetelepresence operations center. The telepresence operations center wouldbe specific to receiving and transmitting life-size images of peoplewith alignment for eye contact. Unlike typical network architectureusing voice or data hubs, the telepresence technologies architecturewould standardize the format of generating the three-dimensionalqualities made possible through life-size communication with a reflectedbackground. Furthermore, the telepresence technologies architecturewould be engineered to synchronize the supporting visuals that wouldaccompany the telepresence communications of life-size digitalembodiments of people.

Through the telepresence technologies architecture, each telepresencelocation would have a permanent IP connection to the telepresenceoperations center. This IP connection could automatically revert to alow bandwidth when the telepresence system is not in use forcommunication. The codec in each location could be much less expensiveand simpler than standard video conference codecs since there would notbe any need for a directory or dialing capabilities. The codec could behardwired to automatically connect to the telepresence operations centerwhen the power to the codec is turned on. With the telepresencetechnologies architecture users would be able to access a directory atthe telepresence operations center that would list the telepresencelocations and provide a current status of whether or not they were inuse or available for a new telepresence communication. Through thetelepresence technologies architecture, all connections betweentelepresence users would be connected and managed through thetelepresence operations center.

FIG. 84 shows an asymmetrical arrangement, which has an off-axis line ofsight 204 for the camera 1 in the customer location 205, while thecamera in the presenter's location 174 has an on-axis line of sight 182.The customer 3 views the image of the presenter appearing to have acorrect alignment for eye contact even though the customer location 202has an off-axis view 203. This perceived eye contact alignment isachieved since the incoming image of the customer 3 is displayed at thelocation of the presenter 174 on the image display device 17 with theeyes of the customer aligned to the height for the line of sight 182 forachieving a perceived eye contact. Even though the camera in thecustomer location 202 is off-axis, the camera view 203 captures theimage of the customer 3 with the eyes at the same height on the image.

As an example, the eyes of the presenter 176 may be at a position of twothirds of the height of the presenter's image. Also, the eyes of thecustomer 3 may be at the position of two thirds of the height of thecustomer's image, even though the camera 1 is off-axis capturing animage from slightly above the normal line of sight 182.

In this asymmetric communications solution the customer receives theadded value of eye contact. The customer will feel the personalconnection with the presenter through eye contact, which can instill agreater sense of trust and intimate presence. Even though the presenterwill not have the same direct line of sight for eye contact, thepresenter will still have a front view of the customer to read reactionsto the marketing communication. The presenter may be selling a productor service with the primary objective of completing the businessobjectives, which does not require the same eye contact to achieve thegoal.

In order to achieve optimal results, the eye contact configuration atthe location of the presenter 174 should meet specific requirements.These requirements are illustrated in the “Telepresence Workstation andTelepresence Center” U.S. patent application No. 60/846,415 by White.One requirement is that the camera 1 is not too close to the presenter176. It is undesirable to have the camera too close to the presenter,which could cause wide angle distortion. This problem is overcome byhaving the camera 1 located close to the floor with a line of sight 177viewing forward to a mirror 42. The mirror 42 reflects an upward facingline of sight 45 toward the two-way mirror 2, which is reflected forwardalong a line of sight 182. The line of sight 182 is aligned with the eyecontact between the presenter 176 and the image of the customer 3appearing on the image display device 17. A black panel 16 is positionedabove the two-way mirror 2 to block the camera view through the two-waymirror. In this arrangement the image display device 17 is relativelyclose to the presenter 176 to allow for clear viewing of the incomingimage from the customer location 201 while not requiring an excessivelylarge area for the workstation.

FIG. 85 shows an embodiment of the present invention with both thecamera 1 and the image display device 17 in front of the two-way mirror2. In this configuration the camera 1 has an unobstructed angle of view45 of the user 3. The user 3 has a line of sight 182 that achieves aperceived eye contact with a telepresent person appearing on thereflected image 5. This eye contact is aligned with the reflected lineof sight 185 with the image display device 17. The camera 1 is viewed asa reflection in position 179 in front of the reflected image 5.

FIG. 86 shows an embodiment of the present invention with a camera 1positioned between an image display device 17 and a two-way mirror 2.The camera is positioned back far enough so that it is not blocking thereflected view 5 of the image display device 17. Furthermore, the camera1 is positioned to have an unobstructed angle of view 45 of the user 3.The user has a perceived eye contact with a telepresent person displayedon the image display device by having a line of sight 182 that matchesto the eye level of the telepresent person viewed as a reflection 5 offthe two-way mirror 2 along the reflected line of sight 185.

FIG. 87 shows an embodiment of the present invention with a camera 1positioned between a two-way mirror 2 and a backdrop 8 with anunobstructed angle of view 45 of the user 3. The user 3 has a perceivedeye contact with a telepresent person appearing on the image displaydevice by way of a line of sight 182 that aligns with the level of theeyes of the telepresent person appearing on the image display device 17.The telepresent person may appear to be in front of a reflection 9 of abackdrop 8, which may produce a perception of depth between the image ofthe telepresent person and the reflected backdrop. The principles of thereflected backdrop are covered in the U.S. Pat. No. 7,057,637 “ReflectedBackdrop for Communications Systems” by White.

FIG. 88 shows an embodiment of the present invention in a configurationsimilar to FIG. 87, except that the arrangement is flipped vertically toposition the camera below the two-way mirror 2 and the image displaydevice 17.

FIG. 89 illustrates the present invention configured as a lectern withboth the camera 1 and the image display device 17 in front of thetwo-way mirror 2. The camera 1 has an unobscured view 45 of the customer3. The customer 3 has a perceived eye contact along the line of sight182 to the image 5, which is the image on the image display device 17reflected by the two-way mirror 2. The two-way mirror 2 may be angledforward at approximately 45 degrees and the image display device may beapproximately horizontal to produce a reflection that is vertical.However, the image display device 17 may be angled back to raise thefront edge to minimize the direct view of the image area by the customer3. If the image display is angled back at a given angle, it is necessaryto angle back the two-way mirror at half of the given angle in order forthe reflected image 5 to be in a vertical position. As an example, thearrangement in FIG. 89 shows the image display device 17 angled back at10 degrees and the two-way mirror 2 angled back 5 degrees beyond 45degrees to be a resulting angle of 50 degrees.

The camera 1 is forward of the two-way mirror 2 and therefore may beseen as a reflection in the two-way mirror. In FIG. 89 the camera 1 ishoused in an enclosure 180, which is in the view of the customer 3 as areflection 181. The enclosure 180 could be designed to be in integralpart of the lectern 184, which could incorporate a banner with a companylogo or the name of a speaker. The enclosure 180 could have a small holefor the camera to have the field of view 45. The reflected enclosure 181could appear to be an integral part of the top of the lectern 184, whichcould appear to be a stand to hold the speakers notes.

The reflected image 5 may display a presenter to appear at the back edgeof the lectern 58. The incoming image of the presenter may be capturedagainst a black backdrop so that the displayed image will only beilluminated by the image of the presenter. In this manner the image areasurrounding the presenter will not be visible since it is black andtherefore the presenter will not appear to be contained within the frameof the image area. When there is a background 191 that is dimlyilluminated the person will appear physically in front of the background191. It is ideal for the background to be illuminated enough to beclearly visible to the audience while not being so bright that it burnsthrough the superimposed image of the presenter 5. In practice it hasbeen effective to have a dark blue curtain that is illuminated from thesides to provide contrasting illuminated blue folds of the curtain withdark shadowed areas to view depth cues between the position of the imageof the presenter 5 and the background 181.

The reflected image plane 5 is only an image that is generated by thereflection of the image display device 17 reflected by the two-waymirror 2 as it is viewed by the customer 3. The space behind the lectern184 is not encumbered by display equipment and is free for a person 187to stand in this space. When there is no image on the image displaydevice 17 there will not be a reflected image 5 to be viewed by thecustomer 3 or an audience. Therefore, it is possible for a person 187 tostand behind the lectern within the view of the audience. In a meetingapplication a person 187 could introduce a guest speaker who after theintroduction could appear at the lectern in the reflected plane 5.

FIG. 90 illustrates the present invention configured as a lectern 184with the camera 1 positioned forward of the two-way mirror 2 andpositioned on the front of the image display device 17. The camera 1 hasan unobscured view 45 of the customer 3, which in some applications mayinclude a large audience. The lectern 184 may be placed on a platform183 for the audience to have a clear view of the presenter at thelectern. The customer 3 has a direct line of sight 182 for eye contact.It is relevant to note that the line of sight 182 does not need to behorizontal to achieve the perception of eye contact. With the incomingimage of the presenter 5 captured on a workstation with a camera at theline of sight for eye contact, the presenter will be looking forward.The customer 3 will see the reflected image on the presenter 5 appearingas a flat image that is directly forward even though the line of sight182 is slightly off-axis. Since the displayed image is flat the slightoff-axis view will not see a different perspective of the presenter,whereas an off-axis view of the real presenter would see a differentperspective of the real three dimensional person.

FIG. 91 illustrates the present invention configured as a lectern 207positioned on a platform 183 with the camera 1 located inside a mockpodium 206 that is reflected in the two-way mirror 2. The platformaccommodates a rear projection arrangement with a projector 189projecting forward to a mirror 190 that reflects the projected image toa rear projection screen 188. The screen 188 could be horizontal orcould be at an angle to make it less visible to the customer 3. In FIG.91 the screen is angled at 10 degrees and the two-way mirror is angledat 50 degrees.

The camera 1 is located between the two-way mirror 2 and the rearprojection screen 188 where it has an unobstructed view 45 of thecustomer 3. Since the camera 1 is in a position that may be within theview of the reflected image 5, it may be positioned within an enclosure206. The enclosure 206 could appear to be an intentional part of thestaging, such as a structure to hold a logo or meeting banner. Theenclosure 206 may have a small hole for the camera to see the field ofview 45. The enclosure 206 may be positioned to match to the location ofa physical lectern 207. The reflected image of the enclosure 206 will beviewed superimposed into the same physical location as the lectern 207.To avoid the confusion of two superimposed images, either the lectern207 or the enclosure 206 may be black to allow the other object toappear without a superimposed image. In order to provide a more visuallyintriguing three dimensional display the enclosure 206 and the lectern207 may be partially open inside or be comprised of a transparentmaterial so that the image of the presenter 5 may appear to be behindthe physical object of the lectern 207.

In FIG. 91 the rear projection screen 188 may be large enough to displaya head to toe person or close to the full body of a person at life-size.The reflected image 5 appears in the free space behind the lectern 207.It is possible for a real person 187 to stand within the reflected imageplane of the presenter 5. The reflected image 5 may be large enough fora real person 187 to stand directly next to a life-size telepresentperson for a two-way conversation.

FIG. 92 illustrates the present invention configured for the appearanceof a head-to-toe image of a person 5 to appear in a three dimensionalsetting with a background 191. A camera 1 is positioned between a largetwo-way mirror 2 and an overhead rear projection screen 188. The camera1 has an unobscured view 45 of a customer 3. A projector 63 projects toa mirror 65 that reflects the projected image to a rear projectionscreen 62. The customer 3 may look forward along a line of sight 56 tosee a perceived eye contact with a life-size person reflected into theplane 5. A real person may walk into the location of plane 5 and alsohave eye-to-eye contact with the customer 3.

FIG. 93 illustrates the present invention configured for the appearanceof a head-to-toe image of a person 5 with a camera 1 positioned above atwo-way mirror 2 and a front projection screen 104 below. The camera 1has an unobscured view 45 of the customer 3. The customer 3 has a lineof sight 182 with the image of the presenter appearing on the reflectedimage plane 5. The projector 189 projects onto the front projectionscreen 104 at an angle to position the projected image under the two-waymirror 2. It may be necessary for the projector 189 to use a lens shiftand/or digital keystone correction to produce an image that is notdistorted. A person 187 may stand in the reflected image plane 5.

FIG. 94A illustrates the present invention configured as a servicecounter with a camera 1 positioned between the two-way mirror 2 and theoverhead image display device 17. The camera 1 has an unobscured view 45of the customer 3. The customer 3 has a line of sight 182 for aperceived eye contact with a presenter appearing on the reflected imageplane 5. The image display device 17 is enclosed within a supportingstructure 193. The image display device may be horizontal or may beangled up to be less visible to the customer 3. In FIG. 94 the imagedisplay device 17 is angled at 10 degrees and the two way mirror isangled at 50 degrees. The enclosure 193 may have exterior graphics 194.

Below the eye contact display device may be a service counter 195. Theservice counter could incorporate a computer 154 and a printer 178,which could be controlled remotely by the presenter appearing in plane5. In business applications the printer 178 could print out boardingpasses, luggage tags, receipts, product information, maps, reservations,or any other printed material that would be of value to the customer 3.

FIG. 95A illustrates the present invention in FIG. 94A with the two-waymirror 2 rotated upwards to allow a person 187 to work at the servicecounter 195. The rotated two-way mirror 2 would become the bottom of theoverhead enclosure 193. When the two-way mirror 2 is rotated upwards thecounter 195 can be used in a normal fashion with the presence of a realperson 187. The computer 154 and printer 178 can be used with thekeyboard 94 by the person 187.

FIG. 94B illustrates the present invention configured as a servicecounter with a camera 1 positioned between the two-way mirror 2 and abackdrop 16. The camera 1 has an unobscured view 45 of the customer 3.The customer 3 has a line of sight 182 for a perceived eye contact witha presenter appearing on an image display device 500. The image displaydevice 500 may be a thin, lightweight LED LCD monitor. Alternatively, itmay be a rear projection acree with an image projected upon it frombehind. The image display device may be vertical to be directly in theview of the customer 3. A backdrop 16 may be above the two way mirror 2and may be a distance above so that the plane of the reflected backdrop9 appears behind the plane of the image display device 500. Theenclosure 193 may have exterior graphics 194.

Below the eye contact display device may be a service counter 195. Theservice counter could incorporate a computer 154 and a printer 178,which could be controlled remotely by the presenter appearing in plane5. In business applications the printer 178 could print out boardingpasses, luggage tags, receipts, product information, maps, reservations,or any other printed material that would be of value to the customer 3.

FIG. 95B illustrates the present invention in FIG. 94B with the two-waymirror 2 and the image display device 500 rotated upwards to allow aperson 187 to work at the service counter 195. The back of the rotatedimage display device 500 would become the bottom of the overheadenclosure 193. When the two-way mirror 2 and the image display deviceare rotated upwards the counter 195 can be used in a normal fashion withthe presence of a real person 187. The computer 154 and printer 178 canbe used with the keyboard 94 by the person 187.

FIG. 96 illustrates the present invention configured as a servicecounter 195 with a camera 1 between a two-way mirror 2 and an imagedisplay device 17 located below. The camera has an unobscured view 45 ofthe customer 3. The customer 3 has a line of sight 182 for eye contactwith a presenter appearing as a reflected image 5. The service countermay have a printer 178 and a computer 154, which could be controlled bythe presenter appearing in the reflected image plane 5. The arrangementof FIG. 96 has the advantage over the arrangement of FIG. 94 in thatthere is not any overhead apparatus. However, the arrangement of FIG. 96may not be as well suited to usage by a real person as illustrated inFIG. 95.

FIG. 97 illustrates the present invention configured as a servicecounter with a camera 1 located above a two-way mirror 2 with the imagedisplay device 17 positioned below and a keyboard 94 and data monitor 69for interaction with a customer 3. The camera 1 has an unobscured view45 of a customer 3. The customer 3 has a perceived eye contact along aline of sight 182 with an image of a presenter on the reflected imageplane 5. A computer 154 and printer 178 may be remotely controlled bythe presenter. The customer may input information, such as their nameand password, for communication with the presenter.

FIG. 98 illustrates the present invention positioned above retailshelving 91 with a camera 1 positioned between a two-way mirror 2 and anoverhead image display device 17. The camera 1 has an unobscured view 45of a customer 3. The customer 3 has a perceived eye contact along a lineof sight 182 with an image of a presenter on the reflected image plane5. The retail shelves 91 below the eye contact communications apparatusmay display retail products. A promotional sales banner 194 may bepositioned on the exterior of the enclosure 193.

FIG. 99 illustrates the present invention positioned above aninteractive computer based kiosk 192 with a camera 2 positioned betweena two-way mirror 2 and an overhead image display device 17. The camera 1has an unobscured view 45 of a customer 3. The customer 3 has aperceived eye contact along a line of sight 182 with an image of apresenter on the reflected image plane 5. A logo or sign 194 may bepositioned on the exterior of the enclosure 193. A customer may inputdata into a computer 154 with a keyboard 94 and view the computer screen69. This computer 154 may be connected by a network to a computerdatabase for access to a vast amount of information. Also, the computer154 may be connected with a network with a computer operated by thepresenter appearing at the reflected image plane 5. With thisarrangement the presenter can engage in eye contact communication with acustomer 3 while sharing visual information and data with the customer.Since both parties can interact with the data, the communication may beinteractive. The resulting information may be printed for the customer 3on the printer 178.

FIG. 100 illustrates the present invention configured as a desk 164 witha camera 1 positioned between a two-way mirror 2 and an overhead imagedisplay device 17. The camera 1 has an unobscured view 45 of a customer3. The customer 3 has a perceived eye contact along a line of sight 182with an image of a presenter on the reflected image plane 5. Thecustomer can interact with the presenter with a computer 154 using akeyboard 94 and monitor 69.

FIG. 101 illustrates the present invention configured as a desk 164 witha camera 1 positioned above the two-way mirror 2. The camera 2 has anunobscured view 45 of a customer 3. The customer 3 has a perceived eyecontact along a line of sight 182 with an image of a presenter on thereflected image plane 5. The customer 3 can interact with the presenterwith a computer 154 using a keyboard 94 and monitor 69.

FIG. 102 illustrates the present invention configured as a desk 164 withthe camera 1 positioned above the two-way mirror 2 with the imagedisplay device 17 and a backdrop 8 reflected in an image plane 9 behindthe image display device 17. The camera 1 has an unobscured view 45 of acustomer 3. The customer 3 has a perceived eye contact along a line ofsight 182 with an image of a presenter on the image display device 17.The customer 3 can interact with the presenter with a computer 154 usinga keyboard 94 and monitor 69. The arrangement can be positioned close toa wall 196 to conserve space, however the reflected backdrop 9 willprovide the perception of a greater depth beyond the wall 196.

FIG. 103 illustrates the present invention configured as a desk 164 witha small image display device 17 behind a two-way mirror 2 with a smallcamera 1 above the two-way mirror 2 and a backdrop 8 reflected to appearin a plane 9 behind the image display device 17. The camera 1 has anunobscured view 45 of a customer 3. The customer 3 has a perceived eyecontact along a line of sight 182 with an image of a presenter on theimage display device 17. The customer 3 can interact with the presenterwith a computer 154 using a keyboard 94 and monitor 69. The arrangementcan be positioned close to a wall 196 to conserve space, however thereflected backdrop 9 will provide the perception of a greater depthbeyond the wall 196.

FIG. 104 illustrates the present invention configured as a conferencetable system 197 with a camera 1 located above a two-way mirror 2 withan image display device 17 located behind and a backdrop 8 reflected toappear on a plane 9 behind the image display device 17. The camera 1 hasan unobscured view 45 of a customer 3. The customer 3 has a perceivedeye contact along a line of sight 182 with an image of a presenter onthe image display device 17. The customer 3 can interact with thepresenter with a computer 154 using a keyboard 94 and monitor 69.

FIG. 105 illustrates retail shelving 91 under the present invention witha camera 1 positioned above a two-way mirror 2 with an image displaydevice 17 behind and a backdrop 8 reflected to appear in a plane 9behind the image display device 17. The camera 1 has an unobscured view45 of a customer 3. The customer 3 has a perceived eye contact along aline of sight 182 with an image of a presenter on the image displaydevice 17. The presenter can promote the products on display on theretail shelves for the customer to select for purchase.

FIG. 106 illustrates a computer based kiosk 192 under the presentinvention with a camera 1 positioned above a two-way mirror 2 with animage display device 17 behind and a backdrop 8 reflected to appear on aplane 9 behind the image display device 17. The camera 1 has anunobscured view 45 of a customer 3. The customer 3 has a perceived eyecontact along a line of sight 182 with an image of a presenter on theimage display device 17. The customer 3 can interact with the presenterwith a computer 154 using a keyboard 94 and monitor 69.

FIG. 107 illustrates an automatic teller machine 198 incorporating thepresent invention with a camera 1 above a two-way mirror 2 with an imagedisplay device 17 behind and a backdrop 8 reflected to appear on a plane9 behind the image display device 17. The camera 1 has an unobscuredview 45 of a customer 3. The customer 3 has a perceived eye contactalong a line of sight 182 with an image of a bank representative on theimage display device 17. The customer 3 can interact with the bankerwith a touch screen 209 to control a computer 154. A cash dispenser 97is incorporated into the ATM 198.

FIG. 108 illustrates a customer representative kiosk as shown in FIG.107 with a backdrop 8 curved to meet the two-way mirror 2 so that thereflected backdrop 9 appears to be a continuation of the backdrop 8.

FIG. 109 illustrates a large scale embodiment of the present inventionwith a camera 1 located above the two-way mirror 2 with an image of afront projection screen 104 and a backdrop 8 reflected to appear in aplane 9 behind the screen 104. The plane of the reflected backdrop 9 maymatch a wall 196 to provide the perception of the backdrop being anextension of a portion of the back wall of the room. The camera 1 has anunobscured view 45 of a customer 3. The customer 3 has a perceived eyecontact along a line of sight 182 with an image of a presenter on thefront projection screen 104.

FIG. 110 illustrates a large scale embodiment of the present inventionwith a camera 1 located above the two-way mirror 2 with a rearprojection screen 188 behind and a backdrop 8 reflected to appear on aplane 9 behind the screen 188. The camera 1 has an unobscured view 45 ofa customer 3. The customer 3 has a perceived eye contact along a line ofsight 182 with an image of a presenter on the rear projection screen188. The rear projection may use a mirror 190 to reflect the projectionto a second mirror 199 to reflect the projection further to the rearprojection screen 188.

FIG. 111 illustrates a large scale embodiment of the present inventionwith a camera 1 located above the two-way mirror 2 with a frontprojection screen 104 behind and a backdrop 8 reflected to appear in aplane 9 behind the front projection screen 104.

FIG. 112 illustrates a large scale embodiment of the present inventionwith a camera 1 located above the two-way mirror 2 with a rearprojection screen 188 behind and a backdrop 8 reflected to appear in aplane 9 behind the rear projection screen 188. The camera 1 has anunobscured view 45 of a customer 3. The customer 3 has a perceived eyecontact along a line of sight 182 with an image of a presenter on therear projection screen 188. The rear projection may use a mirror 190 toreflect the projection to a second mirror 199 to reflect the projectionfurther to the rear projection screen 188.

FIG. 113 illustrates a kiosk embodiment similar to FIG. 106. In thisembodiment the kiosk 192 is a free standing structure that is separatefrom the wall 196 and ceiling 210. The part of the surface of theceiling 210 that is directly above the kiosk is a surface 8 that servesas the backdrop to be reflected in the vertical position 9, whichmatches to the surface of the wall 196. The customer 3 sees the wall 196surrounding the area of the two way mirror 2 and sees a reflection ofthe backdrop surface 8 reflected into the vertical plane 9 matching thesurface of the wall 196. The combination of the reflected backdrop 9 andthe wall 196 viewed on the same plane may give the impression of aseamless surface. However, an image displayed on the monitor 17 willappear in front of this combination of wall 196 and reflected backdrop9.

The embodiment of FIG. 113 may be used in service desk or receptionistcounters where it is advantageous to hide the display equipment andgenerate the perception of a service representative appearing availableto serve customers. The furniture of the kiosk 192 may be designed to becompatible with the decor of office, hotel or store. In particular, thecounter 211 may be visible through the two way mirror 2 so that theservice representative displayed on the monitor 17 would appear directlybehind the counter. A camera 1 would have a view through the two waymirror 2 so that the camera would not be visible to the customer 3. Ablack panel 212 would be placed directly below the camera to avoid thesuperimposition of an image as a reflection off the two way mirror 2. Adata monitor 69 may be positioned in front of the two way mirror 2. Thisdata monitor will not obscure much of the view of the customerrepresentative since the data monitor 69 will not be the same width asthe monitor 17.

In FIG. 113 a light 213 is positioned at an equal distance from the wall196 and the ceiling 210. In this manner the light falling on the walland the ceiling will be from the same angle. This will cause the lighton the surface of the backdrop 8 and the light on the wall 196 to be thesame. In this way the reflected backdrop surface 9 and the wall 196 willhave illumination from the same angle to support the perception of aseamless wall surface.

FIG. 114 is a front view of the configuration illustrated in FIG. 113. Acamera 1 is positioned above the image display device 17. This camera 1may alternatively be behind the two way mirror as described above inFIG. 113. The two way mirror 2 is angled to reflect the backdrop 8located in the ceiling 210. A light 213 is positioned below the ceilingwhere it can illuminate the zone for a user 3. The kiosk 192 has asupporting structure below the counter 211. A data monitor 94 may bepositioned in front of the two way mirror 2. Alternatively it may bebehind the two way mirror to protect the monitor from vandalism.

FIG. 115 illustrates an embodiment of the present invention with abackdrop 8 placed in or on the floor that appears as a reflectedbackdrop 9 in a vertical plane at the location of the wall 196. Theimage on the image display device 17 will appear in front of the wall196. A panel 214 may be located above two way mirror 2 so that the viewof the camera 1 through the two way mirror will view a black surface.Alternatively, the plane 16 may be a black surface. The camera is placedon the floor or close to the floor with a view forward to a mirror 42 toreflect the view upwards to the two way mirror 2 and then toward theuser 3. The camera 1 may be contained within an enclosure 215 that isdark or black so that it does not superimpose into the image viewed bythe user 3.

FIG. 116 illustrates a plan view of the configuration in FIG. 115. Thebackdrop 8 on the floor will appear as a reflection in the verticalplane of the wall 196. A person seated to the side 217 would have a lineof sight 216 that would be blocked by the image display device 17. Thebackdrop 8 is wide enough to provide a reflected image to cover the wideof the wall 196 to the extent of the line of sight 216. A person on theother side 218 would have a line of sight 219 that would not be blockedas much by the image display device 17 and therefore would see more ofthe wall 196. With the width of the backdrop 8 being wide enough for theline of sight 216, there would be some overlap of the reflected backdrop8 and the wall 196. In order to avoid an undesirable superimposition ofthe reflected backdrop 8 and the wall 196 the pattern on each may beproduced to superimpose in an acceptable manner. This may be achieved inthe use of interlaced patterns or designs that incorporate a darkbackground with a random or organized pattern of lighter image areas orfeathered edges.

Numerous inventive applications and methods are also contemplated withinthe broad scope of the present invention. While not intended to belimiting or exhaustive, certain exemplary applications are discussed inthe following paragraphs.

The telepresence technologies architecture described above can beadapted to allow telepresence users, for a fee, to enter virtual socialvenues managed by the telepresence operations center where they couldmeet people in chat rooms or prearranged meetings face-to-face forinteraction with eye contact and natural human communication throughfacial expressions and body language to get to know people throughtelepresence for intellectual dialogue, dating, or intimate experiences.In another embodiment, users could, for a fee, take part in games,competitions, and entertainment that would involve the eye to eyecontact with another person with a shared display of live computergraphics on the second image display device for participation fromtelepresence users connected from any location in the world to thetelepresence operations center.

The telepresence technologies architecture described above may beconfigured to meet a global standards for telepresence and to haveadditional capabilities for specific applications in financial serviceswhere the transmission would be encrypted on a dedicated and securenetwork of a financial institution with a closely controlledtelepresence operations center to deliver confidential financialinformation from banking centers to branch banks. This embodiment wouldpreferably provide bank managers and financial specialists in thelocation of the financial centers to provide personal servicesface-to-face with key customers in remote locations with the sharing ofcritical financial information on the second image display device, alongwith additional equipment to print contracts and digitally scan andtransmit signed contracts. The system preferably includes the equipmentand systems to dispense money, cashier checks and other financialdocuments through the financial institutions telepresence operationscenter.

Another embodiment of the telepresence technologies architectureprovides for telepresence communications systems to be used by medicaltechnicians, physicians and practitioners at any location in the worldto connect to the telepresence global network to reach the telepresenceoperations center where they can offer services to potential patientswho would come to pharmacies and medical facilities where they couldhave an examination, medical test or refill of a prescription at anappointment with a certified physician through telepresence for aface-to-face evaluation. The physician could remotely operate specialistequipment to take blood pressure, cholesterol level, temperature, bloodsugar level and other fundamental tests so that the physician could makenew prescriptions or refill prescriptions and have the medicineautomatically dispensed from the adjoining pharmacy to the patient uponpayment through a credit card reader.

In another embodiment, the above described telepresence technologiesarchitecture could be used by lecturers, professors, trainers and publicspeakers to transmit their presentations over a telepresence networkconnection to the telepresence operations center to have thepresentation digitally recorded and stored as life-size appearances withsynchronized visual support for playback to groups, audiences andclasses that would view the telepresence presentation for a fee. Thepresenter could schedule through the telepresence operations center toappear at the end of the presentation to appear live for questions andanswers, which would allow the presenter to maximize time and generateincome from prerecorded presentations.

Yet another contemplated embodiment for the telepresence technologiesarchitecture is telepresence communications systems produced to theglobal telepresence standard that could be installed in major businesslocations throughout the world so that people seeking a job orconsidering a change in employment could pay to use a room with atelepresence communications system that was connected over atelepresence network connection to the telepresence operations center.Appointments could be scheduled by employment agencies or throughemployment websites for interviews between applicants in one locationand employers in another location with the potential for the applicantto take tests delivered through the telepresence operations center fordisplay on the second image display device with networked services forimmediate results and the potential for the applicant to a transmittedinto the room for a face-to-face interview with the review board orhiring committee.

Still another contemplated embodiment includes the telepresencetechnologies architecture described above wherein the telepresencecommunications systems meeting the global telepresence standards can beinstalled in locations where security companies want to have thepresence of guards, but recognize that the guards would not have anactive role in security unless a security sensor was trigger. The systemcould display a digital recording of a security guard in the locationfor the majority of the time and would instantly switch to a livetelepresence of a guard in the location if a security sensor wastriggered so that the telepresent guard could see and evaluate thesituation, have dialogue with people present and remotely activatealarms, lights and unlock or lock doors.

It should be understood that the drawings and detailed descriptionherein are to be regarded in an illustrative rather than a restrictivemanner, and are not intended to limit the invention to the particularforms and examples disclosed. On the contrary, the invention includesany further modifications, changes, rearrangements, substitutions,alternatives, design choices, and embodiments apparent to those ofordinary skill in the art, without departing from the spirit and scopeof this invention, as defined by the following claims. Thus, it isintended that the following claims be interpreted to embrace all suchfurther modifications, changes, rearrangements, substitutions,alternatives, design choices, and embodiments. For instance, the abovedescribed embodiments could include a microphone adapted to receivesound from the observation zone and a speaker adapted to output sound tothe observation zone. A communication device receiving video images froma camera and compressing said video images for an outgoing transmissionon a network to a second communication system in a remote location and acommunication device receiving an incoming transmission received over anetwork from said second communication system in said remote locationand producing therefrom a video image to be displayed on said imagedisplay device is also contemplated.

Other variations include a communications system wherein the backdroptwo-way mirror, and said light-absorbing panel fold into a supportingstructure when not in use; or a communications system wherein saidtwo-way mirror and said light-absorbing panel can be folded down to forma working desk with a direct view of said image display device. Thecommunications may include a keyboard, mouse or other interactive deviceto allow control of the communications system and/or access interactivevisual and audio material.

The communications system may be adapted for a business transaction andfurther comprise a kiosk incorporating said image display device, saidtwo-way mirror, and said camera, said kiosk further comprising a creditcard reader, a product dispensing device, and storage space for thepromotion and distribution of products. Yet other variations andmodifications will be apparent to one skilled in the art through routineexperimentation and are considered and intended to be within the scopeof the following claims.

What is claimed is:
 1. A telepresence system comprising: a first telepresence communication system in a first location, said first telepresence communication system comprising: a first image display device having a first image area, said first image area being positioned for viewing from a first observation zone in said first location, a two-way mirror positioned between said first observation zone and said first image area, a first camera positioned for viewing a first reflection of said first observation zone off of said two-way mirror, and a first codec communicatively coupled to said first image display device and said first camera, said first codec being configured to receive a first video stream from a network and to transmit a second video stream to said network, said first video stream being for display on said first image area of said first image display device, said second video stream being generated from said first camera; and a second telepresence communication system in a second location remote from said first location, said second telepresence communication system comprising: a second image display device having a second image area, said second image area being positioned for viewing from a second observation zone in said second location, a second camera positioned for viewing a direct, un-reflected view of said second observation zone, and a second codec communicatively coupled to said second image display device and said second camera, said second codec being configured to receive said second video stream from said network and to transmit said first video stream to said network, said second video stream being for display on said second image area of said second image display device, said first video stream being generated from said second camera.
 2. The telepresence system of claim 1, wherein said first telepresence communication system comprises a second mirror, said first camera further being positioned to view a second reflection of said first reflection of said first observation zone off of said second mirror.
 3. The telepresence system of claim 1, wherein said first telepresence communication system comprises a blackout panel positioned along a line of sight of said first camera through said two-way mirror.
 4. The telepresence system of claim 1, wherein said second camera is fixedly attached to said second image display device.
 5. The telepresence system of claim 1, wherein said first telepresence communication system comprises a panel, said first camera being positioned for viewing said first reflection of said first observation zone off of said two-way mirror and through said panel.
 6. The telepresence system of claim 5, wherein said panel is positioned such that a reflection of said panel off of said two-way mirror viewable from said first observation zone appears within said first image area of said first image display device.
 7. The telepresence system of claim 5, wherein said panel is positioned such that a reflection of said panel off of said two-way mirror viewable from said first observation zone appears at a depth further from said first observation zone than said first image area of said first image display device.
 8. The telepresence system of claim 1, wherein said network includes an IP network.
 9. The telepresence system of claim 1, wherein said network comprises a telepresence operations center, said first codec and said second codec being communicatively coupled to said telepresence operations center.
 10. A method comprising: transmitting from a first telepresence communication system a first video stream to a second telepresence communication system remote from said first telepresence communication system, said first video stream being generated from a first camera in said first telepresence communication system, said first camera being positioned to directly view a first observation zone; receiving at said second telepresence communication system said first video stream from said first telepresence communication system; displaying said first video stream on a second image area of a second display device in said second telepresence communication system, said second image area being viewable from a second observation zone; transmitting from said second telepresence communication system a second video stream to said first telepresence communication system, said second video stream being generated from a second camera in said second telepresence communication system, said second camera being positioned to view a reflection of said second observation zone off of a two-way mirror, said two-way mirror being disposed between said second observation zone and said second image area; receiving at said first telepresence communication system said second video stream from said second telepresence communication system; and displaying said first video stream on a first image area of a first display device in said first telepresence communication system, said first image area being viewable from said first observation zone.
 11. The method of claim 10, wherein said transmitting and receiving said first video stream is through a network, and said transmitting and receiving said second video stream is through said network.
 12. The method of claim 11, wherein said network includes an IP network.
 13. The method of claim 11, wherein said network comprises a telepresence operations center, said transmitting said first video stream and said second video stream being through said telepresence operations center.
 14. The method of claim 10, wherein said transmitting said first video stream and receiving said second video stream includes using a first codec in said first telepresence communication system, and said transmitting said second video stream and receiving said first video stream includes using a second codec in said second telepresence communication system.
 15. A system comprising: a network; a first telepresence communication system communicatively coupled to said network using a first codec in said first telepresence communication system, said first codec being configured to transmit and receive a video stream and an audio stream to and from said network, said first codec being communicatively coupled to a first image display device and a first camera in said first telepresence communication system, said first telepresence communication system comprising a two-way mirror, a first image area of said image display device being viewable from a first observation zone through said two-way mirror, said first camera being position to view said first observation zone as a first reflection off of said two-way mirror; and a second telepresence communication system communicatively coupled to said network using a second codec in said second telepresence communication system, said second codec being configured to transmit and receive a video stream and an audio stream to and from said network, said second codec being communicatively coupled to a second image display device and a second camera in said second telepresence communication system, a second image area of said second image display device being directly viewable from a second observation zone, said second camera being position to directly view said second observation zone.
 16. The system of claim 15, wherein said network is an IP network.
 17. The system of claim 15, wherein said network comprises a telepresence operations center, said first codec and said second codec being communicatively coupled to said telepresence operations center in said network.
 18. The system of claim 15, wherein said first telepresence communication system comprises a second mirror, said first camera further being positioned to view said first observation zone as a second reflection of said first reflection off of said second mirror.
 19. The system of claim 15, wherein said first telepresence communication system comprises a blackout panel positioned along a line of sight of said first camera through said two-way mirror.
 20. The system of claim 15, wherein said first telepresence communication system comprises a panel, said first camera being positioned viewing said first reflection of said first observation zone off of said two-way mirror and through said panel, said panel being positioned such that a reflection of said panel off of said two-way mirror viewable from said first observation zone appears at a depth further from said first observation zone than said first image area of said first image display device. 